S&H Form: FORM PTO-1 390 (2/01) 



U.S. DEPARTMENT OF COMMERCE PATENT AND TRADEMARK OFFICE 

TRANSMITTAL LETTER TO THE UNITED STATES 
DESIGNATED/ELECTED OFFICE (DO/EO/US) 
CONCERNING A FILING UNDER 35 U.S.C. 371 


ATTORNEY'S DOCKET NUMBER 
1454.1128 

10/019005 


INTERNATIONAL APPLICATION NO. 
PCT/DEOO/01764 


INTERNATIONAL FILING DATE 

30 May 2000 


PRIORITY DATE CLAIMED 

23 June 1999 



TITLE OF INVENTION 

ASSEMBLY, METHOD, COMPUTER PROGRAM AND STORAGE MEDIUM WHICH CAN BE 
COMPUTE:R-READ FOR THE COMPUTER-AIDED COMPENSATION OF A STATE OF 
INEQUILIERIUM 



APPLICANT(S) FOR DO/EO/US 

Ralf NEUNEIERetal. 'I 

Applicant herewith submits to the United States Designated/Elected Office (DO/EO/US) the following 
items and other information: ^ 

1 . S This is a FIRST submission of items concerning a filing under 35 U.S.C. 371 . 

2. S This is an express request to immediately begin national examination procedures (35 U.S.C. 

371(f)). 

3. ^ The US has been elected by the expiration of 19 months from the priority date (POT Article 31). 

4. 1^ A copy of the International Application as filed (35 U.S.C. 371(c)(2)) 

a. is transmitted herewith (required only if not transmitted by the International Bureau). 

b. □ has been transmitted by the International Bureau. 

c. □ is not required, as the application was filed in the United States Receiving Office (RO/US). 

5. S A translation of the International Application into English (35 U.S.C. 371(c)(2)). 

6. □ Amendments to the claims of the International Application under PCT Article 1 9 (35 U.S.C. 

371(c)(3)) 

a. □ are transmitted herewith (required only if not transmitted by the International Bureau). 

b. □ have been transmitted by the International Bureau. 

c. □ is not required, as the application was filed in the United States Receiving Office (RO/US) 

7. □ A translation of the amendments to the claims under PCT Article 19 (35 U.S.C. 371(c)(3)). 

8. S An oath ordeclarationofthe inventor (35 U.S.C. 371(c)(4)). 

9. □ A translation of the Annexes to the International Preliminary Examination Report under PCT 

Article 36 (35 U.S.C. 371(c)(5)). 

Items 10-15 below concern document(s) or information included: 

10.IEI An Information Disclosure Statement Under 37 CFR 1.97 and 1.98. 

11. ^ An assignment document for recording. 

Please mail the recorded assignment document to: 

a. ^ the person whose signature, name & address appears at the bottom of this document. 

b. □ the following: 

12. ^ A preliminary amendment 

13. ^ A substitute specification 

14. n A change of power of attorney and/or address letter. 

1 5. □ Other items or information: 



Two CD-R's, each containing a copy of the program listing in the International Application, PCT EASY 
forms filed with International Application, copy of cover page of International Application as published, 
and copy of International Search Report. 



©2001 Staas & Halsey LLP 



lU/ UIVUUD 
JG13B«'d>CT/PT0 26 0EC20Q1 



The U.S. National Fee (35 U.S.C. 371(c)(1)) and other fees as follows: 



CLAIMS 



(1)F0R 



(2) NUMBER 
FILED 



(3) NUMBER 
EXTRA 



(4) RATE 



(5) CALCULATIONS 



TOTAL CLAIMS 



18 -20= 



x$ 18.00 



0.00 



INDEPENDENT 
CLAIMS 



-3= 



X $ 84.00 



0.00 



MULTIPLE DEPENDENT CLAIM(S) (if applicable) 



+$280.00 



0.00 



BASIC NATIONAL FEE (37 CFR 1.492(a)(1)-(4): 

□ Neither international preliminary examination fee (37 CFR 1.482) nor 
international search fee (37 CFR 1.445(a)(2)) paid to USPTO $1,040 

S International preliminary examination fee (37 C.F.R. 1.482) not paid to USPTO 
but International Search Report prepared by the ERG or JPO $ 890 

□ International preliminary examination fee (37 C.F.R. 1.482) not paid to USPTO 
but intemational search fee (37 C.F.R. 1 .445(a)(2) paid to USPTO...$ 740 

□ Intemational preliminary examination fee paid to USPTO (37 CFR 1 .482) 
but all claims did not satisfy provision of PCT Article 33(1 )-(4) $ 710 

□ Intemational preliminary examination fee paid to USPTO (37 CFR 1 .482) 
and all claims satisfied provisions of PCT Article 33(2) to (4) $100 



890.00 



Surcharge of $130 forfumishing the National fee or oath or declaration later than 
□ 20 □ 30 mos. from the earliest claimed priority date (37 CFR 

1.482(e)). 



0.00 



TOTAL OF ABOVE 
CALCULATIONS 



890.00 



Reduction by 1/2 for filing by small entity, if applicable. Affidavit must be 
filed also. (Note 37 CFR 1 .9, 1 .27, 1 .28. 



SUBTOTAL 



890.00 



Processing fee of $1 30 for furnishing the English Translation later than 
[ ] 20 [ ] 30 mos. from the earliest claimed priority date (37 CFR 1 .482(f)). 



TOTAL NATIONAL FEE 



Fee for recording the enclosed assignment (37 CFR 1.21(h)). 



1 as? 



TOTAL FEES ENCLOSED 



0.00 



40.00 



930.00 



a. ^ A check in the amount of $ 930.00 to cover the above fees is enclosed. 

b. □ Please charge my Deposit Account No. 1 9-3935 in the Amount of $ to cover the 

above fees. A duplicate copy of this sheet is enclosed, 

c. ^ The Commissioner is hereby authorized to charge any additional fees which may be required, or 

credit any overpayment to Deposit Account No. 19-3935. A duplicate copy of this sheet is 
enclosed. 



21171 

PATENT TRADEMARK OFFICE 



SUBMITTED BY: STAAS & HALSEY LLP 



Type Name 



Richard A. Gollhofer 



Reg. No. 



31,106 



Signature 



Date 



[x/xQ/o{ 



©2001 Staas & Halsey LLP 



10/019005 

«MPaiFrO 2 6 DEC 2001 

Docket No.: 1454.1128 
IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

In re the Application of: 
Ralf NEUNEIER et al. 

Serial No. Group Art Unit: 

Confirmation No. 

Filed: (concun^ently) Examiner: 

For: SYSTEM FOR COMPENSATION OF A STATE OF INEQUILIBRIUM (as amended) 

PRELIMINARY AMENDMENT 

Assistant Commissioner for Patents 
Washington, D.C. 20231 

Sir: 

Before examination of the above-identified application, please amend the application as 

follows: 

IN THE TITLE: 

Please DELETE the Title in its entirety and REPLACE with the following new Title. 
- SYSTEM FOR COMPENSATION OF A STATE OF INEQUILIBRIUM -. 

IN THE SPECIFICATION: 

Please REPLACE the pending specification with the substitute specification attached 

hereto. 

IN THE CLAIMS: 

Please CANCEL without prejudice or disclaimer claims 1-19 in the underlying PCT 
application and ADD new claims 20-37 in accordance with the following: 

20. (NEW) A computer system for compensation of an inequilibrium state of a first 

technical system, comprising: 

a first neural network describing the first technical system; and 

a second neural network describing a second technical system and coupled to 

the first neural network to compensate for an inequilibrium state of the first technical system. 



21. (NEW) The arrangement as claimed in claim 20, wherein said first neural network 
has at least a first input computing element and a second output computing element. 

22. (NEW) The arrangement as claimed in claim 21 , wherein said second neural 
network has at least a second input computing element and a second output computing 
element. 

23. (NEW) The arrangement as claimed in claim 22, wherein at least some of the 
computing elements are artificial neurons. 

24. (NEW) The arrangement as claimed in claim 22, wherein at least some 
connections between computing elements are of variable configuration. 

25. (NEW) The arrangement as claimed in claim 22, wherein at least some 
connections between computing elements have identical weighting values. 

26. (NEW) The arrangement as claimed in claim 22, wherein the first technical system 
and the second technical system are identical. 

27. (NEW) The arrangement as claimed in claim 22, wherein the first technical system 
and the second technical system are each subsystems of a common overall system. 

28. (NEW) The arrangement as claimed in claim 27, wherein said first and second 
neural networks further determine a dynamic of the common overall system. 

29. (NEW) The arrangement as claimed in claim 27, wherein said first and second 
neural networks further predict a future state of the common overall system. 

30. (NEW) The arrangement as claimed in claim 29, wherein said first and second 
neural networks further performing at least one of monitoring and controlling the common 
overall system. 



31. (NEW) The arrangement as claimed in claim 30, wherein the common overall 
system is a chemical reactor. 

32. (NEW) A method for computer-supported compensation of an inequilibrium state of 
a first technical system, comprising: 

supplying a first input variable to a first neural network describing the first 
technical system; 

determining a first output variable, describing an inequilibrium state of the first 
technical system, for the first input variable using the first neural network; 

supplying the first output variable, as a second input variable, to a second neural 
network which describes a second technical system; and 

determining a second output variable, describing a state of the second technical 
system, for the second input variable using the second neural network, to compensate for the 
inequilibrium state of the first technical system by the second neural network. 

33. (NEW) The method as claimed in claim 32, wherein the first technical system and 
the second technical system each describe a subsystem of a common overall system. 

34. (NEW) The method as claimed in claim 33, further comprising determining a 
dynamic of the common overall system using the state of the second technical system. 

35. (NEW) The method as claimed in one of claims 34, further comprising predicting a 
future state of the common overall system. 

36. (NEW) The method as claimed in claim 35, further comprising at least one of 
monitoring and controlling the common overall system. 

37. (NEW) A computer-readable medium storing a computer program for controlling a 
computer to perform a method for compensation of an inequilibrium state of a first technical 
system, said method comprising: 

supplying a first input variable to a first neural network describing the first 
technical system; 

determining a first output variable, describing an inequilibrium state of the first 
technical system, for the first input variable using the first neural network; 



supplying the first output variable, as a second input variable, to a second neural 
network which describes a second technical system; and 

determining a second output variable, describing a state of the second technical 
system, for the second input variable using the second neural network, to compensate for the 
inequilibrium state of the first technical system by the second neural network. 

IN THE ABSTRACT: 

Please DELETE the Abstract in its entirety and replace with the attached Substitute 
Abstract. 

REMARKS 

This Preliminary Amendment is submitted to improve the form of the English translation 
as filed. It is respectfully requested that this Preliminary Amendment be entered in the above- 
referenced application. 

In accordance with the foregoing, claims 1-19 have been canceled and claims 20-37 
have been added. Thus, claims 20-37 are pending and are under consideration. 

A substitute specification is also being filed herewith. The substitute specification is 
accompanied by a marked-up copy of the original specification. 

If there are any questions regarding these matters, such questions can be addressed by 
telephone to the undersigned. Otherwise, an early action on the merits is respectfully solicited. 

If any further fees are required in connection with the filing of this Preliminary 
Amendment, please charge same to our Deposit Account No. 19-3935. 

Respectfully submitted, 

STAAS & HALSEY LLP 

Date: \\Uq/0\ Bv: jLU.fi.AMA 

' ' Richard A. Gollhofer V 

Registration No. 31,106 

700 Eleventh Street, NW, Suite 500 
Washington, D.C. 20001 
(202) 434-1500 
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SUBSTITUTE SPECIFICATION 

TITLE OF THE INVENTION 

SYSTEM FOR COMPENSATION OF AN INEQUILIBRIUM STATE 

CROSS REFERENCE TO RELATED APPLICATIONS 

[0001] This application Is based on and hereby claims priority to Genman Application No. 199 
28 776.7 filed on June 23, 1999, the contents of which are hereby incorporated by reference. 

REFERENCE TO COMPUTER PROGRAM LISTING, COMPACT DISC APPENDIX 

[0002] A compact disc is included herewith and incorporated by reference herein having 
thereon a computer program listing appendix in the ASCII uncompressed text format with ASCII 
carriage return, ASCII line feed and all control codes defined in ASCII, having computer 
compatibility with IBM PC/XT/AT or compatibles, having operating system compatibility with MS- 
Windows and including file PR0GRA'-1 (ProgramListing.txt in Windows) of 98,120 bytes, 
created on December 14, 2001 . 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

[0003] The invention relates to an system, a method, a computer program event and a 
computer-readable storage medium for the computer-supported compensation of an 
inequilibrium state of a technical system. 

2. Description of the Related Art 

[0004] From S. Haykin, Neural Networks: a Comprehensive Foundation, McMillan College 
Publishing Company, 1994, pages 498-533, it is known to use a neural network to determine 
states of a dynamic system and a dynamic which is the basis for a dynamic system, 

[0005] Generally, a dynamic process which occurs in a dynamic system is usually described by 
a state transition description which is not visible to an observer of the dynamic process, and a 
starting equafion which describes observable variables of the technical dynamic process. 

[0006] Such a structure is illustrated in Fig 7. 
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[0007] A dynamic system 700 is subject to the influence of an extemal input variable u with a 
predefinable dimension, an input variable ut at a point in time t being designated as ut: 

I designating a natural number. 

[0008] The input variable ut at a point in time t brings about a change in the dynamic process 
which occurs in the dynamic system 700. 

[0009] An inner state st{s^ e 9?"" ) with a predefinable dimension m at a point in time t cannot 
be observed by an observer of the dynamic system 200. 

[0010] A state transition of the inner state st of the dynamic process is brought about as a 
function of the inner state st and the input variable ut, and the state of the dynamic process 
changes into a subsequent state st+1 at a subsequent point in time t+1. 

Here the following applies: 



where f(,) designates a general mapping rule. 

[0011] An output variable yt^ which can be observed by an observer of the dynamic system 700, 
at a point in time t depends on the input variable ut and on the inner state st- 

[0012] The output variable yt (y^ e 31^ ) has a predefinable dimension n. 

[0013] The dependence of the output variable yt on the input variable ut and the inner state st 
of the dynamic process is given by the following general rule: 

Yt = g(st/ Ut)^ (2) 
where g(.) designates a general mapping rule. 



s. 



(1) 



[0014] In Haykin, an arrangement of interconnected computing elements in the form of a neural 
network of interconnected neurons is used to describe the dynamic system 700. The 



connections between the neurons of the neural network are weighted. The weightings of the 
neural network are connbined in a paranneter vector v. 

[0015] An inner state of a dynamic system, which is subject to a dynamic process, thus 
depends on the input variable ut and the inner state of the preceding point In time st and the 
parameter vector v in accordance with the following rule: 

where NN(.) designates a mapping rule which is defined by the neural network. 

[0016] The arrangement which is known from Haykin and is designated as a Time Delay 
Recurrent Neural Network (TDRNN) is trained in a training phase in such a way that for an input 

variable ut, in each case a target variable -^^ js determined in a real dynamic system. The tupel 
(input variable, detemnined target variable) is referred to as a training data item. A multiplicity of 
such training data items form a training data record. 

[0017] The TDRNN is trained using the training data record. An overview of various training 
methods can also be found in Haykin. 

[0018] It is to be noted at this point that only the output variable yt can be detected at a point in 
time t of the dynamic system 700. The inner system state st is not observable. 

[0019] In the training phase, the following cost function E is usually minimized: 



where T designates a number of points in time to be taken into account. 

[0020] From A. Zell, Simulation Neuronaler Netze, Addison-Wesley Publishing Company, 
Bonn, 1st Ed., 1994, pages 560-561, an arrangement of a plurality of interconnected neuron 
networks is known. 
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(4) 



[0021] In the arrangement known from Zell, a plurality of hierarchically structured neural 
subnetworks are linked together in an overall structure in a parallel arrangement within the 
scope of what is referred to as a gating network. 



[0022] In the gating network, an identical input vector is fed to each of the neural subnetworks. 
The neural subnetworks each determine an output vector in accordance with their internal 
structure. The output vectors of the neural subnetworks are summed in a linearly weighted 
fashion. 

[0023] A training method for the gating network is also referred to in Zell. 

[0024] The known arrangements and methods have, in particular, the disadvantage that 
identification or modeling of a dynamic system and determination of states of a dynamic system 
is possible only with insufficient precision. 

SUMMARY OF THE INVENTION 

[0025] The invention is therefore based on the problem of disclosing an arrangement with which 
a dynamic system can be modeled and a state of the dynamic system can be determined, and 
which permits the modeling and the determination with a greater degree of precision than in the 
known arrangements. 

[0026] In addition, the invention is based on the problem of disclosing a method, a computer 
program event and a computer-readable storage medium with which a dynamic system can be 
modeled and a state of the dynamic system can be determined and which permit the modeling 
and the determination with a greater degree of precision than in the known arrangements. 

[0027] A computer system for compensation of an inequilibrium state of a first technical system 
includes a first neural network which describes the first technical system and a second neural 
network which describes a second technical system. The first and the second neural networks 
are connected to one another in such a way that an inequilibrium state of the first technical 
system can be compensated by the second neural network. 

[0028] In a method for the computer-supported compensation of an inequilibrium state of a first 
technical system, a first neural network, which describes the first technical system, is supplied 
with a first input variable. A first output variable, which describes an inequilibrium state of the 
first technical system, is determined for the first input variable using the first neural network. 
The first output variable is supplied, as a second input variable, to a second neural network, 
which describes a second technical system. A second output variable, which describes a state 
of the second technical system, is detemnined for the second input variable using the second 



neural network, in such a way that the inequilibrium state of the first technical system is 
compensated by the second neural network. 

[0029] A computer program event which comprises a computer-readable storage medium on 
which a program is stored makes it possible, after it has been loaded into a memory of a 
computer, for the computer to execute the following steps for the computer-supported 
compensation of an inequilibrium state of a first technical system: a first neural network, which 
describes the first technical system, is supplied with a first input variable; a first output variable, 
which describes an inequilibrium state of the first technical system, is determined for the first 
input variable using the first neural network; the first output variable is supplied, as a second 
input variable, to a second neural network, which describes a second technical system; and a 
second output variable, which describes a state of the second technical system, is determined 
for the second input variable using the second neural network in such a way that the 
inequilibrium state of the first technical system is compensated by the second neural network. 

[0030] A computer-readable storage medium on which a program is stored makes it possible, 
after it has been loaded into a memory of a computer, for the computer to execute the following 
steps for the computer-supported compensation of an inequilibrium state of a first technical 
system: a first neural network, which describes the first technical system, is supplied with a first 
input variable; a first output variable, which describes an inequilibrium state of the first technical 
system, is determined for the first input variable using the first neural network; the first output 
variable is supplied, as a second input variable, to a second neural network which describes a 
second technical system; and a second output variable, which describes a state of the second 
technical system, is determined for the second input variable using the second neural network, 
in such a way that the inequilibrium state of the first technical system is compensated by the 
second neural network. 

[0031] An inequilibrium state of a system is to be understood as a state of the system which 
according to predefinable criteria does not correspond to a selected state of the system, the 
equilibrium state. 



[0032] The equilibrium state of the system can be distinguished, for example, by the fact that in 
this state the system has stability or effectiveness in terms of a transmission behavior of the 
system. 



[0033] The invention has the particular advantage that a small amount of training data is 
necessary for training the arrangement in order to be able to carry out modeling of a dynamic 
system and the determination of a state of the dynamic system with sufTicient precision using 
the trained arrangement. 

[0034] Preferred developments of the invention emerge from the dependent claims. 

[0035] The developments described below relate both to the method and the arrangement as 
well as to the computer program event and the computer-readable storage medium. 

[0036] The invention and the developments described below can be implemented both by 
software and hardware, for example using a specific electric circuit. 

[0037] The first neural network can be implemented in such a way that it has at least a first 
input computing element and a first output computing element. 

g [0038] The same applies to an implementation of the second neural network. 

In [0039] At least some of the computing elements are preferably artificial neurons. 

CI [0040] In order to simplify training of one implementation of the invention, at least some of the 

111 

^ connections between computing elements are of variable configuration. 

[II [0041] In a further embodiment, at least some of the connections have identical weighting 
ifi values. 

m [0042] For the sake of simplification during a description of a complex overall system, it is 
favorable to structure the complex overall systenri in such a way that the first technical system 
and the second technical system each describe a subsystem of the complex overall system. 

[0043] However, in addition, the first technical system and the second technical system can 
also be identical. 

[0044] Because the invention makes it possible to model a dynamic system with sufficient 
precision, one implementation is preferably used for determining a dynamic of a system. 

[0045] In addition, one configuration is used for forecasting a future state of a system and for 
monitoring and/or controlling a system. 
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[0046] The system is preferably a chemical reactor. 

[0047] Exemplary embodiments of the invention are illustrated in the figures and explained 
below in more detail 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0048] These and other objects and advantages of the present invention will become more 
apparent and more readily appreciated from the following description of the preferred 
embodiments, taken in conjunction with the accompanying drawings of which: 

Figure 1 is a block diagram of a chemical reactor by which variables which are further 
processed by arrangement in accordance with a first exemplary embodiment are measured; 

Figure 2 is a block diagram of an arrangement of neural networks in accordance with the 
first exemplary embodiment; 

Figure 3 is a flowchart of a method in accordance with the first or second exemplary 
embodiment; 

Figure 4 is a block diagram of a neural network in accordance with the first exemplary 
embodiment; 

Figure 5 is a block diagram of a neural network in accordance with a second exemplary 
embodiment; 

Figure 6 is a block diagram of a neural network during training in accordance with the 
second exemplary embodiment; 

Figure 7 is a block diagram of a general description of a dynamic system. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

[0049] Reference will now be made in detail to the preferred embodiments of the present 
invention, examples of which are illustrated in the accompanying drawings, wherein like 
reference numerals refer to like elements throughout. 

[0050] First exemplary embodiment: Chemical Reactor 

[0051] Fig. 1 shows a chemical reactor 100 which is filled with a chemical substance 101 which 
is a mixture of a plurality of basic substances 1 03. The chemical reactor 1 GO comprises an 
agitator 102 with which the chemical substance 101 is agitated. 



[0052] An injection device 150 injects the basic substances 103 into the reactor 100 separately 
from one another. 

[0053] The basic substances 103 which are injected into the chemical reactor 100 react with 
one another during a predefinable time period in the chemical reactor 100, the chemical 
substance 101 being formed. A substance 104 which flows out of the reactor 100 is drawn off 
from the chemical reactor 100 via an output. 

[0054] The injection device 150 is connected via a line to a control unit 105 with which 
monitored injection of any basic substance 103 into the reactor 100 can be set by a control 
signal 106. 

[0055] In addition, a measuring device 107 is provided with which concentrations of the basic 
substances 103 contained in the chemical substance 101, a temperature in the reactor 100 and 
a pressure prevailing in the reactor 100 are measured. 

[0056] Measurement signals 108 are fed to a computer 109, are digitized in the computer 109 
by an input/output interface 110 and an analog/digital converter 111 and stored in a memory 
112. A processor 1 13 is connected, as is the memory 1 12, to the analog/digital converter 1 1 1 
via a bus 1 14. The computer 109 is also connected to the controller 105 of the injection device 
150 via the input/output interface 110, and the computer 109 thus controls the injection of the 
basic substances 103 into the reactor 100. 

[0057] The computer 109 is also connected via the input/output interface 1 10 to a keyboard 
115, a computer mouse 116 and a display screen 117. 

[0058] The chemical reactor 100 is subjected, as a dynamic technical system 200, to a dynamic 
process. 

[0059] The chemical reactor 100 is described by a state description. The input variable ut is 
composed in this case of information relating to the temperature in the chemical reactor 100, to 
the pressure in the chemical reactor 100 and to the agitation frequency set at the point in time t. 
The input variable ut is therefore a three-dimensional vector. 

[0060] The aim of the modeling of the chemical reactor 100 which is described below is to 
determine the dynamic profile of the concentrations of the basic substances 103 in the reactor 
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100 in order to make possible an efficient generation of a predefinable final product as a 
substance 104 which flows out. 

[0061] An efficient generation of the predefinable final product is possible if the basic 
substances 103 are mixed in a ratio of the concentrations of the basic substances 103 which 
corresponds to the reaction to be carried out. 

[0062] The dynamic profile of the concentrations of the basic substances 103 is determined 
using the arrangement which is described below and illustrated in Fig. 3. 

[0063] For the sake of easier comprehension of the principles on which the arrangement is 
based, a basic structure 200 is illustrated in Fig. 2 as a two-part neural network in which a first 
neural network 201 and a second neural network 202 are connected in series. 

[0064] The arrangements described below are each to be understood in such a way that each 
neuron layer or each sublayer has a predefinable number of neurons, i.e. computing elements. 

[0065] In the basic structure illustrated in Fig. 2, the first neural network 201 and the second 
neural network 202 are linked to one another in such a way that outputs of the first neural 
network 201 are connected to inputs of the second neural network 202. 

[0066] The first neural network 201 has a first input layer 210 with a predefinable number of 
input computing elements, i.e. input neurons, to which input variables ut can be supplied at a 
predefinable point in fime t, i.e. in timing series values described below. 

[0067] Furthermore, the first neural network 210 has output computing elements, i.e. output 
neurons, of a first output layer 220. The output neurons of the first output layer 220 are 
connected to the input neurons of the first input layer 21 0. The weightings of the connections 
are contained in a first connection matrix A. 

[0068] The second neural network 202 is connected to the first neural network 201 in such a 
way that the output neurons of the first output layer 220 are connected to input neurons of a 
second input layer 230 in accordance with a structure given by a second connection matrix B. 

[0069] In the second neural network 202, output neurons of a second output layer 240 are 
connected to the input neurons of the second input layer 230. Weightings of the connections 
are contained in a third connection matrix C. 



[00701 The output variables yt for, in each case, one point in time t can be tapped at the output 
neurons of the second output layer 240. 

[0071] The expanded arrangennent illustrated in Fig. 4 is explained below on the basis of this 
basic structure. 

[0072] Fig. 4 shows a third neural network 403 which is linked to the first neural network 401 . 

[0073] The third neural network 403 comprises a third input layer 450 with input neurons which 
are connected to neurons of a concealed layer 460 in accordance with the structure given by 
the first connection matrix A. 

[0074] The third neural network 403 is connected to the first neural network 401 in such a way 
that the neurons of the concealed layer 460 are connected to the output neurons of the first 
output layer 420. Weightings of the connections are contained in a fourth connection matrix D. 

[0075] The input neurons of the third input layer 450 are configured in such a way that the time 
series values ut can be supplied to them as input variables ut-1 at a predefinable point in time t- 
1 

[0076] The principle of what is referred to as shared weighting values (shared weights), i.e. the 
principle that equivalent connection matrices in a neural network have the same values at a 
particular point in time is implemented by the described configuration of the first neural network 
401 and of the third neural network 403 in accordance with Fig. 4. 

[0077] In the arrangement according to Fig. 4, in particular shared weighting values and the 
described configuration of the first input layer 410 and the third input layer 430 ensure that 
states st-1 and st, which are represented by the first output layer 420 and the concealed layer 
460 describe two chronologically successive states t-1 and t of a system s. 

[0078] The back propagation method is used as the training method. The training data record 
is acquired from the chemical reactor 400 in the following way. 

[0079] The concentrations of the basic substances 103 are measured with the measuring 
device 407 with respect to predefined input variables and supplied to the computer 409, 
digitized there and grouped as time series values ut in chronological succession in a memory 
together with the corresponding input variables which correspond to the measured variables. 
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10080] When the arrangement is trained, these time series values ut of the arrangement are 
supplied as a training data record together with the infomiation relating to the predefined 
optimum ratio of the concentrations of the basic substances. 

[0081] The arrangement from Fig. 4 is trained using the training data record. 

[0082] In order to illustrate better the transformations achieved by the arrangement, steps of a 
method sequence 300 are illustrated in Fig. 3 with reference to the first exemplary embodiment. 

[0083] In a first step 310, the anangement is supplied with the time series values of the input 
variable ut which contains the information relating to the temperature, the pressure and the 
agitation frequency in the reactor 100. 

[0084] In a second step 320, the input variable ut is used to determine an output variable ut of 
the first neural network, which output variable ut describes whether the basic substances are 
mixed together in the ratio which is optimized for an effective reaction of the basic substances 
and which constitutes what is referred to as an equilibrium state in the reactor. In this way, it is 
determined in the second step 320 whether a state in the reactor is in an equilibrium state or 
inequilibrium state. 

[0085] In a third layer 330, the output variable st of the first neural networtc is supplied as an 
input variable to the second neural networi^. 

[0086] In a fourth step 340, the second neural network detennines the output variable yt which 
describes a dynamic change in the concentrations of the basic substances. 

[0087] In the fourth step 340, a state with which the inequilibrium state can be compensated is 
determined in the reactor using the determined change in the concentrations of the basic 
substances. 

[0088] The an"angement in Fig. 4 which is trained in accordance with the training method 
described above is used for the open-loop and closed-loop control of the injection process of the 
basic substances 103 into the chemical reactor 100. 

[0089] The aim of the closed-loop and open-loop control is an automated continuous injection 
of the basic substances 103 into the chemical reactor 100 in such a way that the concentration 
ratio of the basic substances 103 in the reactor 100 has a constant ratio which is optimum for 
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the reaction to be carried out. An efficient generation of the predefinable end product as a 
substance 104 which flows out is thus possible. 

[0090] For this purpose, a forecast value yt is determined in an application phase by the 
arrangement for a first input variable yt-1 at a point in time t-1 and for a second input variable ut 
at a point in time t, the forecast value ut being subsequently fed as control variable 420, after 
possible conditioning of the determined value, to the injection device 150 in order to control the 
injection of the basic substances 103 in the chemical reactor 100 (cf. Fig. 1). 

[0091] The structuring of the arrangement in the first neural network and the second neural 
network, in particular an output layer which is formed by this structuring and which produces 
further fault signals, ensures that a small amount of training data is required to train the 
arrangement in order to ensure sufficient precision during modeling of the dynamic system. 

2nd Exemplary embodiment: Exchange Rate Forecast 

[0092] In a second exemplary embodiment, the arrangement described above according to Fig. 
4 is used for an exchange rate forecast of a $/DM exchange rate. 

[0093] A time series with time series values which each comprise information on economic 
figures, for example short-term and long-tenm interest rates in a $ area and a DM area, inflation 
rates and information relating to economic growth in the $ area and the DM area is fed to the 
arrangement as input variable ut. 

[0094] A change in the $/DM exchange rate is forecast by the anrangement as output variable 

yt. 

[0095] In the arrangement for the exchange rate forecast, in particular the connection matrices 
A, B, C and D have a particular configuration. 

[0096] The first connection matrix A is filled with weightings in such a way that only a limited 
number of neurons of the first input layer of the first neural network (a maximum of seven 
neurons in this case) are assigned in each case to a neuron of the first output layer. Such a 
connection matrix is referred to as a "sparse connector". 
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10097] In addition, the arrangement for the exchange rate forecast is configured in such a way 
that the first output layer of the first neural network has a large number of output neurons (200 
output neurons in this case). 

[0098] The second connection matrix B, in this case a highly dimensioned vector, Is configured 
in such a way that the highly dimensional output variable st of the first neural network 
(dimension = 200) is mapped onto a one-dimensional variable using the connection matrix B. In 
particular, all the weightings of the second connection matrix B have the value 1. 

[0099] Accordingly, the third connection matrix C only has a weighting value which additionally 
can assume only positive values. 

[00100] The fourth connection matrix D is configured as a diagonal matrix in which ail the 
diagonal values have the value 1 . 

[00101] The back propagation method is also used as the training method. A training data 
record is formed in the following way. 

[001 02] Known exchange rate changes are grouped as time series values ut in chronological 
succession together with the corresponding economic figures which correspond to the known 
exchange rate changes. 

[001 03] When the arrangement is trained, these time sequence values ut are supplied to the 
arrangement as a training data record. 

[001 04] During the training, a target function E, which is formed in the first output layer of the 
first neural network, has the following rule: 



E 




a 

* zt -> max 



(5) 



where: 



: index which describes a point in time 



T 



: time interval under consideration 



a 



: index for a neuron 
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ln(...) : natural logarithm 

Pt. Pt+1 : exchange rate at the point in time t or t+1 

: an exchanged quantity of money in DM which is assigned to a neuron a. 

[00105] In addition, the following relationships which describe a dynamic exchange rate 
system apply: 

mt - zt (market mechanism of the exchange rate system) (6) 
- Pt * 2t (market mechanism of the exchange rate system) (7) 
0 (equilibrium condition ofthe exchange rate system) (8) 




Z4 

a 

where: 



+ 1' "^t -a quantity of money in $, assigned to a neuron a, at a point in time t+1 or t 

a a 

+ 1' - a quantity of money in DM, assigned to a neuron a, at a point in time t+1 or t. 

[001 06] The arrangement for the exchange rate forecast is based on the following principles: 

[001 07] An inequilibrium state of the exchange rate system which is caused by an excess of 
an amount of money is compensated by a change in the exchange rate. 

[00108] A state of the exchange rate system is described by a decision model which is 
implemented in the first neural network. In this case, in each case a neuron represents what is 
referred to as an "agent". Accordingly, the arrangement for the exchange rate forecast is also 
referred to as "multi-agent system". 

[00109] In the second neural network, a market model is Implemented with which an 
inequilibrium state which is generated by the decision model is compensated by a change in a 
state of an exchange rate market. 
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[001 1 0] An inequilibrium state of the decision model is a cause of a change in state of the 
marl^et model. 

[001 11] An alternative to the second exemplary embodiment is described below. 

[00112] The alternative exemplary embodiment differs from the second exemplary 
embodiment in the following descriptive points. The cor-esponding arrangement of the 
alternative exemplary embodiment for the exchange rate forecast is illustrated in each case in 
Fig. 5 (application phase) and Fig. 6 (training phase). 

[00113] Neuron connections which are broken are represented by dashed lines in the figures. 
Closed neuron connections are illustrated by continuous lines. 

[0011 4] The original arrangement for the exchange rate forecast according to Fig. 4 can be 
changed to the effect that, instead of the third neural network, a fourth input layer 550 is used 
with input neurons which are connected to the output neurons of the second output layer 540 of 
the second neural network. Weightings of the connections are contained in a fifth connection 
matrix E. The connections are implemented in such a way that they are broken in an 
application phase and closed in a training phase. 

[001 15] In addition, the second output layer 540 of the second neural network has a feedback 
with which the output signals of the second output layer 540 are fed back into the second output 
layer 540. Weightings of the feedback are contained in a sixth connection matrix F. The 
feedback is implemented in such a way that it is closed in the application phase and interrupted 
in the training phase. 

[00116] Moreover, the output neurons of the first output layer 520 of the first neural network 
are connected to the output neurons 540 of the second neural network. Weightings of the 
connections are contained in a seventh connection matrix G. 

[001 1 7] The connections between the second input layer 530 and the second output layer 540 
are configured in such a way that they are closed in an application phase and inteniipted in a 
training phase. 

[00118] The fifth connection matrix E and the sixth connection matrix F is each an identity 
matrix Id. 
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[001 19] The seventh connection matrix G is configured in such a way that a mapping which 
carried out using the seventh connection matrix G obeys the following rule: 



IS 



d(ln(^£±i-)) a 
Pt 



(E o < 0 



(9) 



with: 



d(ln(^)) 
Pt 



: derived to In 



[00120] Training of the altemative arrangement is carried out in accordance with the second 
exemplary embodiment. The alternative training an-angement is illustrated in Fig. 6. 

[00121] During the training, the feedback is interrupted and the connections are broken 
between the second input layer 530 and the second output layer 540. 

[00122] In the application phase, a change in an exchange rate with which an Inequilibrium 
state of the market can be compensated can be tapped at the second output layer of the second 
neural network according to an iterative process. 

[00123] Within the framework of the iterative process, the following fixed point problem is 
solved: 



In 



V Pt J 



n + 1 = 



In 



P 



n + 8 * 



f (r 
Z a 



In 



■t + 1 



V J) 



n 



(10) 



In ( )xi Fixed Point 



where: 



weighting of the third connection matrix C, s > 0. 
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N : index for an iteration step 

[00124] The alternative arrangement for the exchange rate forecast is based on the following 
principles: 

[00125] The exchange rate system is in equilibrium at every point in time t. 

[00126] By changing a state of the market model, an inequilibrium state of the decision model 
can be prevented. 

A possible implementation of the above-described second exemplary embodiment and a 
possible implementation of the alternative of the second exemplary embodiment are given 
below for the program SENN, version 2.3. The implementations each comprise three sections 
which each contain program code for processing in SENN, version 2.3. 

t: [00'' 27] The invention has been described in detail with particular reference to preferred 
5; embodiments thereof and examples, but it will be understood that variations and modifications 
Uh can be effected within the spirit and scope of the invention. 

%^ 



m 
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ABSTRACT 

SYSTEM FOR COMPENSATION OF AN INEQUILIBRIUM STATE 

A first neural network describes a first technical system and a second neural network 
describes a second technical system. The first and the second neural networks are connected 
to one another in such a way that an inequilibrium state of the first technical system is 
compensated by the second neural network. 
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MARKED-UP COPY OF SUBSTITUTE SPECIFICATION 

[Description] TITLE OF THE INVENTION 

[ARRANGEMENT AND METHOD AND COMPUTER PROGRAM EVENT AND COMPUTER- 
READABLE STORAGE MEDIUM] SYSTEM FOR [THE COMPUTER-SUPPORTED] 
COMPENSATION OF AN INEQUILIBRIUM STATE [OF A TECHNICAL SYSTEM] 

CROSS REFERENCE TO RELATED APPLICATIONS 

[0001] This application is based on and hereby claims priority to German Application No. 199 
28 776.7 filed on June 23. 1999. the contents of which are hereby incorporated bv reference. 

REFERENCE TO COMPUTER PROGRAM LISTING. COMPACT DISC APPENDIX 

pi« [0002] A compact disc is included herewith and incorporated by reference herein having 

y thereon a computer program listing appendix in the ASCII uncompressed text format with ASCII 

|*i carriage return. ASCII line feed and all control codes defined in ASCII, having computer 

5j compatibility with IBM PC/XT/AT or compatibles, having operating system compatibility with MS- 



Windows and including file PROGRA-1 (ProgramListing.txt in Windows) of 98.120 bytes, 
created on December 14. 2001. 



[0003] The invention relates to an [arrangement] system , a method, a computer program event 
and a computer-readable storage medium for the computer-supported compensation of an 
inequilibrium state of a technical system. 

2. Description of the Related Art 

[0004] From [1] S. Haykin, Neural Networks: a Comprehensive Foundation. McMillan College 
Publishing Company. 1994, pages 498-533. it is known to use a neural network to determine 
states of a dynamic system and a dynamic which is the basis for a dynamic system. 

[0005] Generally, a dynamic process which occurs in a dynamic system is usually described by 
a state transition description which is not visible to an observer of the dynamic process, and a 
starting equation which describes observable variables of the technical dynamic process. 
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BACKGROUND OF THE INVENTION 



1. Field of the Invention 



• 



[0006] Such a structure is illustrated in Fig 7 . 

[0007] A dynamic system 700 is subject to the influence of an external input variable u with a 
predefinable dimension, an input variable ut at a point in time t being designated as ut: 

I designating a natural number. 

[0008] The input variable ut at a point in time t brings about a change in the dynamic process 
which occurs in the dynamic system 700. 

[0009] An inner state st (5^ e 9?"* ) with a predefinable dimension m at a point in time t cannot 
be observed by an observer of the dynamic system 200. 

[0010] A state transition of the inner state st of the dynamic process is brought about as a 
function of the inner state st and the input variable ut, and the state of the dynamic process 
changes into a subsequent state st+1 at a subsequent point in time t+1 . 

Here the following applies: 



at a point in time t depends on the input variable uj and on the inner state s^. 

[0012] The output variable yt (y^ e 9?"^ ) has a predefinable dimension n. 

[0013] The dependence of the output variable yt on the input variable ut and the inner state st 
of the dynamic process is given by the following general rule: 



(1) 



where f(.) designates a general mapping rule. 



[0011] An output variable y^^ which can be observed by an observer of the dynamic system 700, 




(2) 



where g(.) designates a general mapping rule. 



[0014] In [1] Haykin . an arrangement of interconnected computing elements in the form of a 
neural network of interconnected neurons is used to describe the dynamic system 700. The 
connections between the neurons of the neural network are weighted. The weightings of the 
neural network are combined in a parameter vector v, 

[0015] An inner state of a dynamic system, which is subject to a dynamic process, thus 
depends on the input variable ut and the inner state of the preceding point in time st and the 
parameter vector v in accordance with the following rule: 



where NN{.) designates a mapping rule which is defined by the neural network. 

[0016] The arrangement which is known from [1] Haykin and is designated as a Time Delay 
Recurrent Neural Network (TDRNN) is trained in a training phase in such a way that for an input 

d 

variable ut, in each case a target variable is determined in a real dynamic system. The tupel 
(input variable, determined target variable) is referred to as a training data item. A multiplicity of 
such training data items form a training data record. 

[0017] The TDRNN is trained using the training data record. An overview of various training 
methods can also be found in [1] Haykin . 

[0018] It is to be noted at this point that only the output variable yt can be detected at a point in 
time t of the dynamic system 700. The inner system state st is not observable. 

[0019] In the training phase, the following cost function E is usually minimized: 



(3) 




mm, 



(4) 



where T designates a number of points in time to be taken into account. 



[0020] From [2] A. Zell, Simulation Neuronaler Netze, Addison-Wesley Publishing Company, 
Bonn, 1st Ed.. 1994, pages 560-561 , an arrangement of a plurality of interconnected neuron 
networks is known. 



[0021] In the arrangement known from [2] ZeH, a plurality of hierarchically structured neural 
subnetworks are linked together in an overall structure in a parallel arrangement within the 
scope of what is referred to as a gating network. 

[0022] In the gating network, an identical input vector is fed to each of the neural subnetworks. 
The neural subnetworks each determine an output vector in accordance with their internal 
structure. The output vectors of the neural subnetworks are summed in a linearly weighted 
fashion. 

[0023] A training method for the gating network is also referred to in [2] ZeH. 

[0024] The known arrangements and methods have, in particular, the disadvantage that 
identification or modeling of a dynamic system and determination of states of a dynamic system 
is possible only with insufficient precision. 

Q SUMMARY OF THE INVENTION 

[0025] The invention is therefore based on the problem of disclosing an arrangement with which 
:5 a dynamic system can be modeled and a state of the dynamic system can be determined, and 
which [arrangement] permits the modeling and the determination with a greater degree of 

yi 

r ' precision than in the known arrangements. 

[II [0026] In addition, the invention is based on the problem of disclosing a method, a computer 

fa 5 

gl program event and a computer-readable storage medium with which a dynamic system can be 
CI modeled and a state of the dynamic system can be detemnined and which permit the modeling 
and the determination with a greater degree of precision than in the known arrangements. [The 
problems are achieved by means of the arrangement and the methods having the features 
according to the independent claims.] 

[0027] [An arrangement] A computer system for [the computer-supported] compensation of an 
inequilibrium state of a first technical system [comprises] includes a first neural network which 
describes the first technical system and a second neural network which describes a second 
technical system. The first and the second neural [network] networks are connected to one 
another in such a way that an inequilibrium state of the first technical system can be 
compensated by the second neural network. 
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[0028] In a method for the computer-supported compensation of an inequilibrium state of a first 
technical system, a first neural network, which describes the first technical system, is supplied 
with a first input variable. A first output variable, which describes an inequilibrium state of the 
first technical system, is determined for the first input variable using the first neural network. 
The first output variable is supplied, as a second input variable, to a second neural network, 
which describes a second technical system. A second output variable, which describes a state 
of the second technical system, is determined for the second input variable using the second 
neural network, in such a way that the inequilibrium state of the first technical system is 
compensated by the second neural network. 

[0029] A computer program event which comprises a computer-readable storage medium on 
which a program is stored makes it possible, after it has been loaded into a memory of a 
computer, for the computer to execute the following steps for the computer-supported 
compensation of an inequilibrium state of a first technical system: [-] a first neural network, 
which describes the first technical system, is supplied with a first input variable; [-] a first output 
variable, which describes an inequilibrium state of the first technical system, is determined for 
the first input variable using the first neural network; [-] the first output variable is supplied, as a 
second input variable, to a second neural network, which describes a second technical system; 
[-] and a second output variable, which describes a state of the second technical system, is 
determined for the second input variable using the second neural network in such a way that the 
inequilibrium state of the first technical system is compensated by the second neural network. 

[0030] A computer-readable storage medium on which a program is stored makes it possible, 
after it has been loaded into a memory of a computer, for the computer to execute the following 
steps for the computer-supported compensation of an inequilibrium state of a first technical 
system: [-] a first neural network, which describes the first technical system, is supplied with a 
first input variable; [-] a first output variable, which describes an inequilibrium state of the first 
technical system, is determined for the first input variable using the first neural network; [-] the 
first output variable is supplied, as a second input variable, to a second neural network which 
describes a second technical system; [-] and a second output variable, which describes a state 
of the second technical system, is determined for the second input variable using the second 
neural network, in such a way that the inequilibrium state of the first technical system is 
compensated by the second neural network. 



[0031] An inequilibrium state of a system is to be understood as a state of the system which 
according to predefinable criteria does not conrespond to a selected state of the system, the 
equilibrium state. 

[0032] The equilibrium state of the system can be distinguished, for example, by the fact that in 
this state the system has stability or effectiveness in terms of a transmission behavior of the 
system. 

[0033] The invention has the particular advantage that a small amount of training data is 
necessary for training the arrangement in order to be able to carry out modeling of a dynamic 
system and the determination of a state of the dynamic system with sufficient precision using 
the trained arrangement. 

[0034] Preferred developments of the invention emerge from the dependent claims. 

[0035] The developments described below relate both to the method and the arrangement as 
well as to the computer program event and the computer-readable storage medium. 

[0036] The invention and the developments described below can be implemented both by 
software and hardware, for example using a specific electric circuit. 

[0037] The first neural network can be implemented in such a way that it has at least a first 
input computing element and a first output computing element. 

[0038] The same applies to an implementation of the second neural network. 

[0039] At least some of the computing elements are preferably artificial neurons. 

[0040] In order to simplify training of one implementation of the invention, at least some of the 
connections between computing elements are of variable configuration. 

[0041] In a further embodiment, at least some of the connections have identical weighting 
values. 

[0042] For the sake of simplification during a description of a complex overall system, it is 
favorable to structure the complex overall system in such a way that the first technical system 
and the second technical system each describe a subsystem of the complex overall system. 
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[0043] However, in addition, the first technical system and the second technical system can 
also be identical. 

[0044] Because the invention makes it possible to model a dynamic system with sufficient 
precision, one implementation is preferably used for determining a dynamic of a system. 

[0045] In addition, one configuration is used for forecasting a future state of a system and for 
monitoring and/or controlling a system. 

[0046] The system is preferably a chemical reactor. 

[0047] Exemplary embodiments of the invention are illustrated in the figures and explained 
below in more detail[. In said figures:] 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0048] [****] These and other objects and advantages of the present invention will become more 
apparent and more readily appreciated from the following description of the preferred 
embodiments, taken in coniunction with the accompanying drawings of which: 

Figure 1 [shows an outline] is a block diagram of a chemical reactor by which variables 
which are further processed [with the] by arrangement in accordance with a first exemplary 
embodiment are measured; 

Figure 2 [shows an outline] is a block diagram of an arrangement of neural networks in 
accordance with the first exemplary embodiment; 

Figure 3 [shows an outline which describes] is a flowchart of a method [sequence] in 
accordance with the first or second exemplary embodiment; 

Figure 4 [shows an outline of an arrangement] is a block diagram of a neural network in 
accordance with the first exemplary embodiment; 

Figure 5 [shows an outline of an arrangement] is a block diagram of a neural network in 
accordance with a second exemplary embodiment; 

Figure 6 [shows an outline of an arrangement] is a block diagram of a neural network 
during training in accordance with the second exemplary embodiment; 

Figure 7 [shows an outline] is a block diagram of a general description of a dynamic 
system. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

[0049] Reference will now be made in detail to the preferred embodiments of the present 
invention, examples of which are illustrated in the accompanying drawings, wherein like 
reference numerals refer to like elements throughout. 

[0050] First exemplary embodiment: Chemical Reactor 

[0051] Fig. 1 shows a chemical reactor 100 which is filled with a chemical substance 101 which 
is a mixture of a plurality of basic substances 103. The chemical reactor 100 comprises an 
agitator 102 with which the chemical substance 101 is agitated. 

[0052] An injection device 150 injects the basic substances 103 into the reactor 100 separately 
from one another. 

[0053] The basic substances 103 which are injected into the chemical reactor 100 react with 
one another during a predefinable time period in the chemical reactor 100, the chemical 
substance 101 being fornned. A substance 104 which flows out of the reactor 100 is drawn off 
from the chemical reactor 100 via an output. 

[0054] The injection device 150 is connected via a line to a control unit 105 with which 
monitored injection of any basic substance 103 into the reactor 100 can be set by [means of] a 
control signal 106. 

[0055] In addition, a measuring device 107 is provided with which concentrations of the basic 
substances 103 contained in the chemical substance 101, a temperature in the reactor 100 and 
a pressure prevailing in the reactor 100 are measured. 

[0056] Measurement signals 108 are fed to a computer 109, are digitized in the computer 109 
by [means of] an input/output interface 110 and an analog/digital converter 111 and stored in a 
memory 112. A processor 113 is connected, as is the memory 112, to the analog/digital 
converter 111 via a bus 114. The computer 109 is also connected to the controller 105 of the 
injection device 150 via the input/output interface 110, and the computer 109 thus controls the 
injection of the basic substances 103 into the reactor 100. 

[0057] The computer 109 is also connected via the input/output interface 1 10 to a keyboard 
115, a computer mouse 116 and a display screen 117. 
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[0058] The chemical reactor 100 is subjected, as a dynamic technical system 200, to a dynamic 
process. 

[0059] The chemical reactor 100 is described by [means of] a state description. The input 
variable ut is composed in this case of information relating to the temperature in the chemical 
reactor 100, to the pressure in the chemical reactor 100 and to the agitation frequency set at the 
point in time t. The input variable ut is therefore a three-dimensional vector. 

[0060] The aim of the modeling of the chemical reactor 100 which is described below is to 
determine the dynamic profile of the concentrations of the basic substances 103 in the reactor 
100 in order to make possible an efficient generation of a predefinable final product as a 
substance 104 which flows out. 

[0061] An efficient generation of the predefinable final product is possible if the basic 
substances 103 are mixed in a ratio of the concentrations of the basic substances 103 which 
corresponds to the reaction to be carried out. 

[0062] The dynamic profile of the concentrations of the basic substances 103 is determined 
using the arrangement which is described below and illustrated in Fi g. 3 . 

[0063] For the sake of easier comprehension of the principles on which the arrangement is 
based, a basic structure 200 is illustrated in Fig. 2 as a two-part neural network in which a first 
neural network 201 and a second neural network 202 are connected in series. 

[0064] The arrangements described below are each to be understood in such a way that each 
neuron layer or each sublayer has a predefinable number of neurons, i.e. computing elements. 

[0065] In the basic structure illustrated in Fig. 2 , the first neural network 201 and the second 
neural network 202 are linked to one another in such a way that outputs of the first neural 
network 201 are connected to inputs of the second neural network 202. 

[0066] The first neural network 201 has a first input layer 210 with a predefinable number of 
input computing elements, i.e. input neurons, to which input variables ut can be supplied at a 
predefinable point in time t, i.e. in timing series values described below. 

[0067] Furthermore, the first neural network 210 has output computing elements, i.e. output 
neurons, of a first output layer 220. The output neurons of the first output layer 220 are 
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connected to the input neurons of the first input layer 210. The weightings of the connections 
are contained in a first connection matrix A. 

[0068] The second neural network 202 is connected to the first neural network 201 in such a 
way that the output neurons of the first output layer 220 are connected to input neurons of a 
second input layer 230 in accordance with a structure given by a second connection matrix B. 

[0069] In the second neural network 202, output neurons of a second output layer 240 are 
connected to the input neurons of the second input layer 230. Weightings of the connections 
are contained in a third connection matrix C. 

[0070] The output variables yt for, in each case, one point in time t can be tapped at the output 
neurons of the second output layer 240. 

[0071] The expanded arrangement illustrated in Fig. 4 is explained below on the basis of this 
basic structure. 

[0072] Fig. 4 shows a third neural network 403 which is linked to the first neural network 401 . 

[0073] The third neural network 403 comprises a third input layer 450 with input neurons which 
are connected to neurons of a concealed layer 460 in accordance with the structure given by 
the first connection matrix A. 

[0074] The third neural network 403 is connected to the first neural network 401 in such a way 
that the neurons of the concealed layer 460 are connected to the output neurons of the first 
output layer 420. Weightings of the connections are contained in a fourth connection matrix D. 

[0075] The input neurons of the third input layer 450 are configured in such a way that the time 
series values ut can be supplied to them as input variables ut-1 at a predefinable point in time t- 
1. 

[0076] The principle of what is refen-ed to as shared weighting values (shared weights), i.e. the 
principle that equivalent connection matrices in a neural network have the same values at a 
particular point in time is implemented by [means of] the described configuration of the first 
neural network 401 and of the third neural network 403 in accordance with Fig. 4 . 

[0077] In the arrangement according to Fig. 4 , in particular shared weighting values and the 
described configuration of the first input layer 410 and the third input layer 430 ensure that 
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states st-1 and st, which are represented by the first output layer 420 and the concealed layer 
460 describe two chronologically successive states t-1 and t of a system s. 

[0078] The back propagation method is used as the training method. The training data record 
is acquired from the chemical reactor 400 in the following way. 

[0079] The concentrations of the basic substances 103 are measured with the measuring 
device 407 with respect to predefined input variables and supplied to the computer 409, 
digitized there and grouped as time series values ut in chronological succession in a memory 
together with the corresponding input variables which correspond to the measured variables. 

[0080] When the arrangement Is trained, these time series values ut of the arrangement are 
supplied as a training data record together with the information relating to the predefined 
optimum ratio of the concentrations of the basic substances. 

[0081] The arrangement from Fig. 4 is trained using the training data record. 

[0082] In order to illustrate better the transfomnations achieved by [means of] the arrangement, 
steps of a method sequence 300 are illustrated in Fig. 3 with reference to the first exemplary 
embodiment. 

[0083] In a first step 310, the arrangement is supplied with the time series values of the input 
variable ut which contains the information relating to the temperature, the pressure and the 
agitation frequency in the reactor 100. 

[0084] In a second step 320, the input variable ut is used to determine an output variable ut of 
the first neural network, which output variable ut describes whether the basic substances are 
mixed together in the ratio which is optimized for an effective reaction of the basic substances 
and which constitutes what is referred to as an equilibrium state in the reactor. In this way, it is 
determined in the second step 320 whether a state in the reactor is in an equilibrium state or 
inequilibrium state. 

[0085] In a third layer 330, the output variable st of the first neural network is supplied as an 
input variable to the second neural network. 

[0086] In a fourth step 340. the second neural network determines the output variable yt which 
describes a dynamic change in the concentrations of the basic substances. 



11 



[0087] In the fourth step 340, a state with which the inequilibrium state can be compensated Is 
determined in the reactor using the determined change in the concentrations of the basic 
substances. 

[0088] The arrangement in Fig. 4 which is trained in accordance with the training method 
described above is used for the open-loop and closed-loop control of the injection process of the 
basic substances 103 into the chemical reactor 100. 

[0089] The aim of the closed-loop and open-loop control is an automated continuous injection 
of the basic substances 103 into the chemical reactor 100 in such a way that the concentration 
ratio of the basic substances 103 in the reactor 100 has a constant ratio which is optimum for 
the reaction to be carried out. An efficient generation of the predefinable end product as a 
substance 104 which flows out is thus possible. 

[0090] For this purpose, a forecast value yt is determined in an application phase by the 
arrangement for a first input variable yt-1 at a point in time t-1 and for a second input variable ut 
at a point in time t, [said] the forecast value ut being subsequently fed as control variable 420, 
after possible conditioning of the determined value, to the injection device 150 in order to control 
the injection of the basic substances 103 in the chemical reactor 100 (cf. Fig. 1 ). 

[0091] The structuring of the arrangement in the first neural network and the second neural 
network, in particular an output layer which is formed by this structuring and which produces 
further fault signals, ensures that a small amount of training data is required to train the 
arrangement in order to ensure sufficient precision during modeling of the dynamic system. 

2nd Exemplary embodiment: Exchange Rate Forecast 

[0092] In a second exemplary embodiment, the an-angement described above according to Fjg^ 
4 is used for an exchange rate forecast of a $/DM exchange rate. 

[0093] A time series with time series values which each comprise information on economic 
figures, for example short-temn and long-term interest rates in a $ area and a DM area, inflation 
rates and infomriation relating to economic growth in the $ area and the DM area is fed to the 
arrangement as input variable ut. 

[0094] A change in the $/DM exchange rate is forecast by the arrangement as output variable 

yt. 
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[0095] In the arrangement for the exchange rate forecast, in particular the connection matrices 
A, B, C and D have a particular configuration. 

[0096] The first connection matrix A is filled with weightings in such a way that only a limited 
number of neurons of the first input layer of the first neural network (a maximum of seven 
neurons in this case) are assigned in each case to a neuron of the first output layer. Such a 
connection matrix is referred to as a "sparse connector". 

[0097] In addition, the arrangement for the exchange rate forecast is configured in such a way 
that the first output layer of the first neural network has a large number of output neurons (200 
output neurons in this case). 

[0098] The second connection matrix B, in this case a highly dimensioned vector, is configured 
in such a way that the highly dimensional output variable st of the first neural network 
(dimension = 200) is mapped onto a one-dimensional variable using the connection matrix B. In 
particular, all the weightings of the second connection matrix B have the value 1. 

[0099] Accordingly, the third connection matrix C only has a weighting value which additionally 
can assume only positive values. 

[00100] The fourth connection matrix D is configured as a diagonal matrix in which all the 
diagonal values have the value 1 . 

[00101] The back propagation method is also used as the training method. A training data 
record is fomied in the following way. 

[00102] Known exchange rate changes are grouped as time series values ut in chronological 
succession together with the corresponding economic figures which correspond to the known 
exchange rate changes. 

[00103] When the arrangement is trained, these time sequence values ut are supplied to the 
arrangement as a training data record. 

[00104] During the training, a target function E, which is fomied in the first output layer of the 
first neural network, has the following rule: 
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E 

T 



* z t ^ max (5) 



where: 

t : index which describes a point in time 

T : time interval under consideration 

a : index for a neuron 

ln(...) : natural logarithm 

Pti Pt+1 • exchange rate at the point in time t or t+1 



: an exchanged quantity of money in DM which is assigned to a neuron a. 

[00105] In addition, the following relationships which describe a dynamic exchange rate 
system apply: 

+ 1 ~ 2t (market mechanism of the exchange rate system) (6) 



n^_j_j = nt - Pt * zt (market mechanism of the exchange rate system) (7) 
^ zt = 0 (equilibrium condition ofthe exchange rate system) (8) 



where: 



+ 1' • Q quantity of money in $, assigned to a neuron a, at a point in time t+1 or t 

+ 1' • • 3 quantity of money in DM, assigned to a neuron a, at a point in time t+1 or t. 

[00106] The arrangement for the exchange rate forecast is based on the following principles: 
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[00107] An inequilibrium state of the exchange rate system which is caused by an excess of 
an amount of money is compensated by a change in the exchange rate. 

[00108] A state of the exchange rate system is described by a decision model which is 
implemented in the first neural network. In this case, in each case a neuron represents what is 
referred to as an "agent". Accordingly, the arrangement for the exchange rate forecast is also 
referred to as "multi-agent system". 

[00109] In the second neural network, a market model is implemented with which an 
inequilibrium state which is generated by the decision model is compensated by a change in a 
state of an exchange rate market. 

[001 10] An inequilibrium state of the decision model is a cause of a change in state of the 
market model. 

[001 11] An alternative to the second exemplary embodiment is described below. 

[001 12] The alternative exemplary embodiment differs from the second exemplary 
embodiment in the following descriptive points. The corresponding arrangement of the 
alternative exemplary embodiment for the exchange rate forecast is illustrated in each case in 
Fig, 5 (application phase) and Fig. 6 (training phase). 

[00113] Neuron connections which are broken are represented by dashed lines in the figures. 
Closed neuron connections are illustrated by continuous lines. 

[001 14] The original arrangement for the exchange rate forecast according to Fig. 4 can be 
changed to the effect that, instead of the third neural network, a fourth input layer 550 is used 
with input neurons which are connected to the output neurons of the second output layer 540 of 
the second neural network. Weightings of the connections are contained in a fifth connection 
matrix E. The connections are implemented in such a way that they are broken in an 
application phase and closed in a training phase. 

[00115] in addition, the second output layer 540 of the second neural network has a feedback 
with which the output signals of the second output layer 540 are fed back into the second output 
layer 540. Weightings of the feedback are contained in a sixth connection matrix F. The 
feedback is implemented in such a way that it is closed in the application phase and interrupted 
in the training phase. 
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[001 1 6] Moreover, the output neurons of the first output layer 520 of the first neural network 
are connected to the output neurons 540 of the second neural network. Weightings of the 
connections are contained in a seventh connection matrix G. 

[00117] The connections between the second input layer 530 and the second output layer 540 
are configured in such a way that they are closed in an application phase and inten^upted in a 
training phase. 

[001 18] The fifth connection matrix E and the sixth connection matrix F is each an identity 
matrix Id. 

[00119] The seventh connection matrix G is configured in such a way that a mapping which is 
carried out using the seventh connection matrix G obeys the following rule: 

^ (Z ^t) < 0 (9) 

d(ln(^^)) ^ 
Pt 

with: 



d{ln(^)) 



: derived to In 



+ 1 



[00120] Training of the alternative arrangement is carried out in accordance with the second 
exemplary embodiment. The alternative training arrangement is illustrated in Fig. 6 . 

[00121] During the training, the feedback is interrupted and the connections are broken 
between the second input layer 530 and the second output layer 540. 

[00122] In the application phase, a change in an exchange rate with which an inequilibrium 
state of the market can be compensated can be tapped at the second output layer of the second 
neural network according to an iterative process. 

[001 23] Within the framework of the iterative process, the following fixed point problem is 
solved: 
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In 



+ 1 



n + 1 = 



In 



V Pt ) 



n + 8 * 



Z a 



In 



^t + 1 ' 



n 



(10) 



+ 1 

In ( )n Fixed Point 



where: 



8 : weigliting of the third connection matrix C, s > 0. 
N : index for an iteration step 

[00124] The alternative arrangement for the exchange rate forecast is based on the following 
principles: 

[00125] The exchange rate system is in equilibrium at every point in time t 

[00126] By changing a state of the market model, an inequilibrium state of the decision model 
can be prevented. 

A possible implementation of the above-described second exemplary embodiment and a 
possible implementation of the alternative of the second exemplary embodiment are given 
below for the program SENN, version 2.3. The implementations each comprise three sections 
which each contain [a] program code[, said codes being necessary] for processing in SENN, 
version 2.3. 

[00127] The invention has been described in detail with particular reference to preferred 
embodiments thereof and examples, but it will be understood that variations and modifications 
can be effected within the spirit and scope of the invention. 



[Possible implementation of the second exemplary embodiment:] 
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[Program listing on pages 22-67 has been deleted and stored on the CD-R disc submitted herewith] 
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Description 

Arrangement and method and computer program event and 
computer- readable storage medium for the computer- supported 
compensation of an inequilibrium state of a technical system 

The invention relates to an arrangement, a method, a computer 
program event and a computer-readable storage medium for the 
computer- supported compensation of an inequilibrium state of 
a technical system. 

From [1] it is known to use a neural network to determine 
states of a dynamic system and a dynamic which is the basis 
for a dynamic system. 

Generally, a dynamic process which occurs in a dynamic system 
is usually described by a state transition description which 
is not visible to an observer of the dynamic process, and a 
starting equation which describes observable variables of the 
technical dynamic process. 

Such a structure is illustrated in Fig 7 . 

A dynamic system 700 is subject to the influence of an 
external input variable u with a predefinable dimension, an 
input variable at a point in time t being designated as 
^t- 

Ut G 

1 designating a natural number. 



The input variable u^ at a point in time t brings about a 
change in the dynamic process which occurs in the dynamic 
system 700. 
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An inner state ( e 9^"^ ) with a predefinable dimension m 

at a point in time t cannot be observed by an observer of the 
dynami c sys t em 2 00. 

A state transition of the inner state s^ of the dynamic 

process is brought about as a function of the inner state s^ 
and the input variable Uf and the state of the dynamic 
process changes into a subsequent state s^+i at a subsequent 
point in time t+1. 



Here the following applies: 

St+i = f(st'^t)- (1) 
15 where f (.) designates a general mapping rule. 

An output variable y^^ which can be observed by an observer 

of the dynamic system 700, at a point in time t depends on 
the input variable u^ and on the inner state s^. 

20 

The output variable y^ (y^. e has a predefinable 

dimension n. 

The dependence of the output variable y^ on the input 
25 variable and the inner state s^ of the dynamic process is 

given by the following general rule: 

Yt = g(st/ ^t)' (2) 

30 where g(.) designates a general mapping rule. 

In [1] , an arrangement of interconnected computing elements 
in the form of a neural network of interconnected neurons is 
used to describe the dynamic system 700. The connections 
35 between the neurons of the neural network are weighted. The 
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weightings of the neural network are combined in a parameter 
vector V. 

An inner state of a dynamic system, which is subject to a 
dynamic process, thus depends on the input variable u^ and 
the inner state of the preceding point in time s^ and the 
parameter vector v in accordance with the following rule: 

St+i = Nn(v, s^, uJ, (3) 

where NN(.) designates a mapping rule which is defined by the 
neural network. 



The arrangement which is known from [1] and is designated as 
15 a Time Delay Recurrent Neural Network (TDRNN) is trained in a 
training phase in such a way that for an input variable u^, 
in each case a target variable y^ is determined in a real 
dynamic system. The tupel (input variable, determined target 
variable) is referred to as a training data item. A 
20 multiplicity of such training data items form a training data 
record. 

The TDRNN is trained using the training data record. An 
overview of various training methods can also be found in 
25 [1] . 

It is to be noted at this point that only the output variable 
can be detected at a point in time t of the dynamic system 
700. The inner system state s^- is not observable. 
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In the training phase, the following cost function E is 
usually minimized: 

E = ;;£tt -Yt)' ^ r,in, (4) 

T t=l 



35 
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where T designates a number of points in time to be taken 
into account . 



From [2] , an arrangement of a plurality of interconnected 
5 neuron networks is known. 

In the arrangement known from [2] , a plurality of 
hierarchically structured neural subnetworks are linked 
together in an overall structure in a parallel arrangement 
10 within the scope of what is referred to as a gating network. 

In the gating network, an identical input vector is fed to 
each of the neural subnetworks. The neural subnetworks each 
determine an output vector in accordance with their internal 
15 structure. The output vectors of the neural subnetworks are 
summed in a linearly weighted fashion. 

A training method for the gating network is also referred to 
in [2] . 

20 

The known arrangements and methods have, in particular, the 
disadvantage that identification or modeling of a dynamic 
system and determination of states of a dynamic system is 
possible only with insufficient precision. 

25 

The invention is therefore based on the problem of disclosing 
an arrangement with which a dynamic system can be modeled and 
a state of the dynamic system can be determined, and which 
arrangement permits the modeling and the determination with a 
30 greater degree of precision than in the known arrangements. 

In addition, the invention is based on the problem of 
disclosing a method, a computer program event and a computer- 
readable storage medium with which a dynamic system can be 
35 modeled and a state of the dynamic system can be determined 
and which permit the modeling and the determination with a 
greater degree of precision than in the known arrangements. 
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The problems are achieved by means of the arrangement and the 
methods having the features according to the independent 
claims . 

An arrangement for the computer- supported compensation of an 
inequilibrium state of a first technical system comprises a 
first neural network which describes the first technical 
system and a second neural network which describes a second 
technical system. The first and the second neural network are 
connected to one another in such a way that an inequilibrium 
state of the first technical system can be compensated by the 
second neural network. 

In a method for the computer-supported compensation of an 
inequilibrium state of a first technical system, a first 
neural network, which describes the first technical system, 
is supplied with a first input variable. A first output 
variable, which describes an inequilibrium state of the first 
technical system, is determined for the first input variable 
using the first neural network. The first output variable is 
supplied, as a second input variable, to a second neural 
network, which describes a second technical system. A second 
output variable, which describes a state of the second 
technical system, is determined for the second input variable 
using the second neural network, in such a way that the 
inequilibrium state of the first technical system is 
compensated by the second neural network. 

A computer program event which comprises a computer- readable 
storage medium on which a program is stored makes it 
possible, after it has been loaded into a memory of a 
computer, for the computer to execute the following steps for 
the computer- supported compensation of an inequilibrium state 
of a first technical system: 

- a first neural network, which describes the first technical 
system, is supplied with a first input variable; 
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- a first output variable, which describes an inequilibrium 
state of the first technical system, is determined for the 
first input variable using the first neural network; 

- the first output variable is supplied, as a second input 
5 variable, to a second neural network, which describes a 

second technical system; 

- a second output variable, which describes a state of the 
second technical system, is determined for the second input 
variable using the second neural network in such a way that 

10 the inequilibrium state of the first technical system is 
compensated by the second neural network. 

A computer- readable storage medium on which a program is 
stored makes it possible, after it has been loaded into a 

15 memory of a computer, for the computer to execute the 
following steps for the computer- supported compensation of an 
inequilibrium state of a first technical system: 
" a first neural network, which describes the first technical 
system, is supplied with a first input variable; 

20 - a first output variable, which describes an inequilibrium 
state of the first technical system, is determined for the 
first input variable using the first neural network; 

- the first output variable is supplied, as a second input 
variable, to a second neural network which describes a second 

25 technical system; 

- a second output variable, which describes a state of the 
second technical system, is determined for the second input 
variable using the second neural network, in such a way that 
the inequilibrium state of the first technical system is 

3 0 compensated by the second neural network. 

An inequilibrium state of a system is to be understood as a 

state of the system which according to predefinable criteria 
does not correspond to a selected state of the system, the 
35 equilibrium state. 
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The equilibrium state of the system can be distinguished, for 
example, by the fact that in this state the system has 
stability or effectiveness in terms of a transmission 
behavior of the system. 

5 

The invention has the particular advantage that a small 
amount of training data is necessary for training the 
arrangement in order to be able to carry out modeling of a 
dynamic system and the determination of a state of the 
10 dynamic system with sufficient precision using the trained 
arrangement . 

Preferred developments of the invention emerge from the 
dependent claims. 

15 

The developments described below relate both to the method 
and the arrangement as well as to the computer program event 
and the computer -readable storage medium. 

20 The invention and the developments described below can be 
implemented both by software and hardware, for example using 
a specific electric circuit. 

The first neural network can be implemented in such a way 
25 that it has at least a first input computing element and a 
first output computing element. 

The same applies to an implementation of the second neural 
network , 



30 



At least some of the computing elements are preferably 
artificial neurons. 



35 



In order to simplify training of one implementation of the 
invention, at least some of the connections between computing 
elements are of variable configuration. 
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In a further embodiment, at least some of the connections 
have identical weighting values. 

For the sake of simplification during a description of a 
5 complex overall system, it is favorable to structure the 
complex overall system in such a way that the first technical 
system and the second technical system each describe a 
subsystem of the complex overall system. 

10 However, in addition, the first technical system and the 
second technical system can also be identical. 

Because the invention makes it possible to model a dynamic 
system with sufficient precision, one implementation is 
15 preferably used for determining a dynamic of a system. 



In addition, one configuration is used for forecasting a 
5^ future state of a system and for monitoring and/or 

controlling a system. 



20 



25 



30 



The system is preferably a chemical reactor. 

Exemplary embodiments of the invention are illustrated in the 
figures and explained below in more detail. In said figures: 

Figure 1 shows an outline of a chemical reactor by which 
variables which are further processed with the 
arrangement in accordance with a first exemplary 
embodiment are measured; 

Figure 2 shows an outline of an arrangement in accordance 
with the first exemplary embodiment; 



35 



Figure 3 



shows an outline which describes a method sequence 
in accordance with the first or second exemplary 
embodiment ; 
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Figure 4 shows an outline of an arrangement in accordance 
with the first exemplary embodiment; 

Figure 5 shows an outline of an arrangement in accordance 
with a second exemplary embodiment; 

Figure 6 shows an outline of an arrangement during training 
in accordance with the second exemplary embodiment; 

Figure 7 shows an outline of a general description of a 
dynamic system. 

First exemplary embodiment: Chemical Reactor 

Fig. 1 shows a chemical reactor 100 which is filled with- a 
chemical substance 101 which is a mixture of a plurality of 
basic substances 103. The chemical reactor 100 comprises an 
agitator 102 with which the chemical substance 101 is 
agitated. 

An injection device 150 injects the basic substances 103 into 
the reactor 100 separately from one another. 

The basic substances 103 which are injected into the chemical 
reactor 100 react with one another during a predefinable time 
period in the chemical reactor 100, the chemical substance 
101 being formed. A substance 104 which flows out of the 
reactor 100 is drawn off from the chemical reactor 100 via an 
output . 

The injection device 150 is connected via a line to a control 
unit 105 with which monitored injection of any basic 
substance 103 into the reactor 100 can be set by means of a 
control signal 106. 

In addition, a measuring device 107 is provided with which 
concentrations of the basic substances 103 contained in the 
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chemical substance 101, a temperature in the reactor 100 and 
a pressure prevailing in the reactor 10 0 are measured. 



Measurement signals 108 are fed to a computer 109, are 
5 digitized in the computer 109 by means of an input /output 
interface 110 and an analog/digital converter 111 and stored 
in a memory 112. A processor 113 is connected, as is the 
memory 112, to the analog/digital converter 111 via a bus 
114. The computer 109 is also connected to the controller 105 
10 of the injection device 150 via the input/output interface 
110, and the computer 109 thus controls the injection of the 
basic substances 103 into the reactor 100. 



The computer 109 is also connected via the input/output 
.... 15 interface 110 to a keyboard 115, a computer mouse 116 and a 
display screen 117. 

The chemical reactor 100 is subjected, as a dynamic technical 
system 200, to a dynamic process. 

20 

The chemical reactor 100 is described by means of a state 
description. The input variable u^ is composed in this case 
of information relating to the temperature in the chemical 
reactor 100, to the pressure in the chemical reactor 100 and 
25 to the agitation frequency set at the point in time t. The 
input variable u^ is therefore a three-dimensional vector. 

The aim of the modeling of the chemical reactor 100 which is 
described below is to determine the dynamic profile of the 
30 concentrations of the basic substances 103 in the reactor 100 
in order to make possible an efficient generation of a 
predefinable final product as a substance 104 which flows 
out . 



35 



An efficient generation of the predefinable final product is 
possible if the basic substances 103 are mixed in a ratio of 
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the concentrations of the basic substances 103 which 
corresponds to the reaction to be carried out. 

The dynamic profile of the concentrations of the basic 
5 substances 103 is determined using the arrangement which is 
described below and illustrated in Fig. 3 . 

For the sake of easier comprehension of the principles on 
which the arrangement is based, a basic structure 200 is 
^ 10 illustrated in Fig, 2 as a two-part neural network in which a 
first neural network 201 and a second neural network 202 are 
connected in series. 

^f; The arrangements described below are each to be understood in 

S 15 such a way that each neuron layer or each sublayer has a 
Ni: predefinable number of neurons, i.e. computing elements. 

. 

%^ 

?l In the basic structure illustrated in Fig. 2 , the first 

HI neural network 201 and the second neural network 2 02 are 

20 linked to one another in such a way that outputs of the first 

|=ES 

f|l neural network 201 are connected to inputs of the second 

rll neural network 202. 

y[ The first neural network 201 has a first input layer 210 with 

25 a predefinable number of input computing elements, i.e. input 
neurons, to which input variables u^ can be supplied at a 
predefinable point in time t, i.e. in timing series values 
described below. 

30 Furthermore, the first neural network 210 has output 
computing elements, i.e. output neurons, of a first output 
layer 220. The output neurons of the first output layer 220 
are connected to the input neurons of the first input layer 
210. The weightings of the connections are contained in a 

35 first connection matrix A. 
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The second neural network 202 is connected to the first 
neural network 2 01 in such a way that the output neurons of 
the first output layer 22 0 are connected to input neurons of 
a second input layer 230 in accordance with a structure given 
5 by a second connection matrix B. 

In the second neural network 202, output neurons of a second 
output layer 240 are connected to the input neurons of the 
second input layer 230. Weightings of the connections are 
10 contained in a third connection matrix C. 

The output variables y^ for, in each case, one point in time 
t can be tapped at the output neurons of the second output 
layer 240. 



15 



The expanded arrangement illustrated in Fig . 4 is explained 
Jf below on the basis of this basic structure. 

Q 

m Fig. 4 shows a third neural network 403 which is linked to the 

20 first neural network 401. 

5 

Hi The third neural network 403 comprises a third input layer 
450 with input neurons which are connected to neurons of a 

Lji concealed layer 460 in accordance with the structure given by 

25 the first connection matrix A. 



The third neural network 403 is connected to the first neural 
network 401 in such a way that the neurons of the concealed 
layer 460 are connected to the output neurons of the first 
30 output layer 420. Weightings of the connections are contained 
in a fourth connection matrix D. 



The input neurons of the third input layer 450 are configured 
in such a way that the time series values u^ can be supplied 

35 to them as input variables u^-i at a predefinable point in 
time t-1. 
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The principle of what is referred to as shared weighting 
values (shared weights), i.e. the principle that equivalent 
connection matrices in a neural network have the same values 
at a particular point in time is implemented by means of the 
5 described configuration of the first neural network 401 and 
of the third neural network 403 in accordance with Fig. 4 , 

In the arrangement according to Fig. 4 , in particular shared 
weighting values and the described configuration of the first 
10 input layer 410 and the third input layer 430 ensure that 
states St-i and s^/ which are represented by the first output 
layer 420 and the concealed layer 460 describe two 
chronologically successive states t-1 and t of a system s. 

15 The back propagation method is used as the training method. 
The training data record is acquired from the chemical 
reactor 400 in the following way. 

The concentrations of the basic substances 103 are measured 
20 with the measuring device 407 with respect to predefined 
input variables and supplied to the computer 409, digitized 
there and grouped as time series values u^ in chronological 
succession in a memory together with the corresponding input 
variables which correspond to the measured variables . 



25 



30 



When the arrangement is trained, these time series values u^ 
of the arrangement are supplied as a training data record 
together with the information relating to the predefined 
optimum ratio of the concentrations of the basic substances. 

The arrangement from Fig, 4 is trained using the training 
data record. 



In order to illustrate better the transformations achieved by 
35 means of the arrangement, steps of a method sequence 300 are 
illustrated in Fig. 3 with reference to the first exemplary 
embodiment . 
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In a first step 310, the arrangement is supplied with the 
time series values of the input variable u^ which contains 
the information relating to the temperature, the pressure and 
5 the agitation frequency in the reactor 100. 

In a second step 320, the input variable u^ is used to 
determine an output variable u^ of the first neural network, 
which output variable u^ describes whether the basic 
10 substances are mixed together in the ratio which is optimized 
for an effective reaction of the basic substances and which 
constitutes what is referred to as an equilibrium state in 
the reactor. In this way, it is determined in the second step 

Q 320 whether a state in the reactor is in an equilibrium state 

P 15 or inequilibrium state. 



20 



In a third layer 330, the output variable of the first 
neural network is supplied as an input variable to the second 
neural network. 

In a fourth step 340, the second neural network determines 
the output variable y^ which describes a dynamic change in 
the concentrations of the basic substances. 

25 In the fourth step 340, a state with which the inequilibrium 
state can be compensated is determined in the reactor using 
the determined change in the concentrations of the basic 
substances . 

30 The arrangement in Fig. 4 which is trained in accordance with 
the training method described above is used for the open- loop 
and closed- loop control of the injection process of the basic 
substances 103 into the chemical reactor 100. 



35 



The aim of the closed- loop and open- loop control is an 
automated continuous injection of the basic substances 103 
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into the chemical reactor 100 in such a way that the 
concentration ratio of the basic substances 103 in the 
reactor 100 has a constant ratio which is optimum for the 
reaction to be carried out. An efficient generation of the 
5 predefinable end product as a substance 104 which flows out 
is thus possible. 

For this purpose, a forecast value is determined in an 
application phase by the arrangement for a first input 
10 variable yt-i at a point in time t-1 and for a second input 
variable u^ at a point in time t, said forecast value u^ 
being subsequently fed as control variable 420, after 
possible conditioning of the determined value, to the 
f'l injection device 150 in order to control the injection of the 

Ci 15 basic siibstances 103 in the chemical reactor 100 
(cf . FiQ. 1) . 



CI The structuring of the arrangement in the first neural 

network and the second neural network, in particular an 
20 output layer which is formed by this structuring and which 
ril produces further fault signals, ensures that a small amount 

SS. 5 
8 ! : 

'4^ of training data is required to train the arrangement in 

Q order to ensure sufficient precision during modeling of the 

dynamic system. 

25 



2nd Exemplary embodiment : Exchange Rate Forecast 

In a second exemplary embodiment, the arrangement described 
above according to Fig. 4 is used for an exchange rate 
forecast of a $/DM exchange rate. 

A time series with time series values which each comprise 
information on economic figures, for example short-term and 
long-term interest rates in a $ area and a DM area, inflation 
rates and information relating to economic growth in the 
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$ area and the DM area is fed to the arrangement as input 
variable . 

A change in the $/DM exchange rate is forecast by the 
5 arrangement as output variable y^. 

In the arrangement for the exchange rate forecast, in 
particular the connection matrices A, B, C and D have a 
particular configuration. 

10 

The first connection matrix A is filled with weightings in 
such a way that only a limited number of neurons of the first 
input layer of the first neural network (a maximum of seven 
neurons in this case) are assigned in each case to a neuron 
15 of the first output layer. Such a connection matrix is 
referred to as a ''sparse connector" . 

In addition, the arrangement for the exchange rate forecast 
is configured in such a way that the first output layer of 
20 the first neural network has a large number of output neurons 
(200 output neurons in this case) . 

The second connection matrix B, in this case a highly 
dimensioned vector, is configured in such a way that the 
25 highly dimensional output variable s^- of the first neural 
network (dimension = 200) is mapped onto a one-dimensional 
variable using the connection matrix B. In particular, all 
the weightings of the second connection matrix B have the 
value 1 . 



30 



Accordingly, the third connection matrix C only has a 
weighting value which additionally can assume only positive 
values . 



35 



The fourth connection matrix D is configured a;s a diagonal 
matrix in which all the diagonal values have the value 1. 
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The back propagation method is also used as the training 
method. A training data record is formed in the following 
way. 

5 Known exchange rate changes are grouped as time series values 
Ut in chronological succession together with the 
corresponding economic figures which correspond to the known 
exchange rate changes. 

10 When the arrangement is trained, these time sequence values 
u^ are supplied to the arrangement as a training data record. 



15 



During the training, a target function E, which is formed in 
the first output layer of the first neural network, has the 
following rule: 



20 



25 



1 V- 



In 



where : 

t 

T 

a 

In ( . . . ) 

Pf Pt+l 
zt 



•t+i 



* z t -» max 



(5) 



index which describes a point in time 
time interval under consideration 
index for a neuron 
natural logarithm 

exchange rate at the point in time t or t+1 
an exchanged quantity of money in DM which is 
assigned to a neuron a. 



In addition, the following relationships which describe a 
dynamic exchange rate system apply: 

Tn^_^j = m^ - (market mechanism of the exchange rate system) (6) 
30 n^^j = n§ - pt * Zt (market mechanism of the exchange rate 

system) (7) 

^ z^ = 0 (equilibrium condition of the exchange rate 
a 

system) (8) 
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where : 

m^_j_p mt : a quantity of money in $, assigned to a neuron a, 

at a point in time t+1 or t 
^t+l'^t • • ^ quantity of money in DM, assigned to a neuron 
5 a, at a point in time t+1 or t. 

The arrangement for the exchange rate forecast is based on 
the following principles: 

10 An inequilibrium state of the exchange rate system which is 
caused by an excess of an amount of money is compensated by a 
change in the exchange rate. 

A state of the exchange rate system is described by a 
15 decision model which is implemented in the first neural 
network. In this case, in each case a neuron represents what 
is referred to as an '''agent" . Accordingly, the arrangement 
for the exchange rate forecast is also referred to as 
''multi -agent system" . 

20 

In the second neural network, a market model is implemented 
with which an inequilibrium state which is generated by the 
decision model is compensated by a change in a state of an 
exchange rate market . 

25 

An inequilibrium state of the decision model is a cause of a 
change in state of the market model . 

An alternative to the second exemplary embodiment is 
30 described below. 

The alternative exemplary embodiment differs from the second 
exemplary embodiment in the following descriptive points. The 
corresponding arrangement of the alternative exemplary 
35 embodiment for the exchange rate forecast is illustrated in 
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each case in fig. 5 (application phase) and fig. 6 (training 
phase) . 

Neuron connections which are broken are represented by dashed 
5 lines in the figures. Closed neuron connections are 
illustrated by continuous lines. 

The original arrangement for the exchange rate forecast 
according to fig. 4 can be changed to the effect that, 

10 instead of the third neural network, a fourth input layer 550 
is used with input neurons which are connected to the output 
neurons of the second output layer 540 of the second neural 
network. Weightings of the connections are contained in a 
fifth connection matrix E. The connections are implemented in 

15 such a way that they are broken in an application phase and 
closed in a training phase. 



In addition, the second output layer 540 of the second neural 
network has a feedback with which the output signals of the 
20 second output layer 540 are fed back into the second output 
layer 540. Weightings of the feedback are contained in a 
sixth connection matrix F. The feedback is implemented in 
5.^ such a way that it is closed in the application phase and 

interrupted in the training phase. 



25 



30 



35 



Moreover, the output neurons of the first output layer 520 of 
the first neural network are connected to the output neurons 
540 of the second neural network. Weightings of the 
connections are contained in a seventh connection matrix G. 

The connections between the second input layer 530 and the 
second output layer 540 are configured in such a way that 
they are closed in an application phase and interrupted in a 
training phase. 

The fifth connection matrix E and the sixth connection matrix 
F is each an identity matrix Id. 
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The seventh connection matrix G is configured in such a way 
that a mapping which is carried out using the seventh 
connection matrix G obeys the following rule: 



d(ln(^^)) « 



(9) 



with: 



d(lii(^ 



derived to In 



•)) 



Training of the alternative arrangement is carried out in 
accordance with the second exemplary embodiment . The 
alternative training arrangement is illustrated in Fig. 6 . 

During the training, the feedback is interrupted and the 
connections are broken between the second input layer 530 and 
the second output layer 540. 

In the application phase, a change in an exchange rate with 
which an inequilibrium state of the market can be compensated 
can be tapped at the second output layer of the second neural 
network according to an iterative process. 

Within the framework of the iterative process, the following 
fixed point problem is solved: 



In 



■t + 1 



n + 1 



+ 1 



In 



n + s * 



I a 



-t + 1 



In 



n 



(10) 



Pt + 1 

ln{ )n Fixed Point 
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where : 

e : weighting of the third connection matrix C, s > 0. 

N : index for an iteration step 

The alternative arrangement for the exchange rate forecast is 
based on the following principles: 

The exchange rate system is in equilibrium at every point in 
time t. 

By changing a state of the market model, an inequilibrium 
state of the decision model can be prevented. 

A possible implementation of the above -de scribed second 
exemplary embodiment and a possible implementation of the 
alternative of the second exemplary embodiment are given 
below for the program SENN, version 2.3. The implementations 
each comprise three sections which each contain a program 
code, said codes being necessary for processing in SENN, 
version 2.3. 
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Possible implementation of the second exemplary embodiment 



1. Parameter File: 



For the application phase: 

BpNet { 
Globals { 
Wt Penalty { 
sel NoPenalty 
Weigend { 

Lambda { 0.000000 } 
AutoAdapt { T } 
wO { 1.000000 } 
DeltaLambda { 0.000001 } 
ReducFac { 0.900000 } 
Gamma { 0.900000 } 
DesiredError { 0.000000 } 

} 

WtDecay { 

Lambda { 0.010000 } 
AutoAdapt { F } 
AdaptTime { 10 } 
EpsObj { 0.001000 } 
Ob j Set { Training } 
EpsilonFac { 1.000000 } 

} 

ExtWtDecay { 

Lambda { 0.001000 } 
AutoAdapt { F } 
AdaptTime { 10 } 
EpsObj { 0.001000 } 
Ob j Set { Training } 
EpsilonFac { 1.000000 } 

} 

Finnoff { 

AutoAdapt { T } 
Lambda { 0.000000 } 
DeltaLambda { 0.000001 } 
ReducFac { 0.900000 } 
Gamma { 0.900000 } 
DesiredError { 0.000000 } 

} 

} 

ErrorFunc { 
sel LnCosh 
|x| { 

parameter { 0.050000 } 

} 

LnCosh { 

parameter { 2.000000 } 

} 

} 

AnySave { 

file_name { f.Globals.dat } 

} 

AnyLoad { 

file_name { f.Globals.dat } 

} 

ASCII { F } 

} 

LearnCtrl { 
sel Stochastic 
Stochastic { 

PatternSelection { 
sel Permute 
SiibSample { 

Percent { 0.500000 } 
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ExpRandom { 

Lambda { 2.000000 } 

} 

} 

Wt Prune Ctrl { 
PruneSchedule { 
sel FixSchedule 
FixSchedule { 
Limit_0 { 10 } 
Limit_l { 10 } 
Limit_2 { 10 } 
Limit_3 { 10 } 
RepeatLast { T } 

} 

DynSchedule { 
MaxLength { 4 } 
MinimumRuns { 0 } 
Training { F } 
Validation { T } 
Generalization { F } 

DivSchedule { 

Divergence { 0.100000 
MinEpochs { 5 } 

} 

} 

PruneAlg { 
sel FixPrune 
FixPrune { 

Perc_0 { 0.10 0000 } 
Perc_l { 0.100000 } 
Perc_2 { 0.100000 } 
Perc_3 { 0.100000 } 

} 

Epsi Prune { 

DeltaEps { 0.050000 } 
StartEps { 0.050000 } 
MaxEps { 1.000000 } 
ReuseEps { F } 

} 

} 

Tracer { 

Active { F } 

Set { Validation } 

File { trace } 

} 

Active { F } 
Randomize { 0.000000 } 
PruningSet { Train . +Val id . 
Method { S- Pruning } 

} 

StopControl { 
EpochLimit { 
Active { F } 
MaxEpoch { 60 } 

} 

MovingExpAverage { 
Active { F } 
MaxLength { 4 } 
Training { F } 
Validation { T } 
Generalization { F } 
Decay { 0.900000 } 

} 

CheckObjectiveFct { 
Active { F } 
MaxLength { 4 } 
Training { F } 
Validation { T } 
Generalization { F } 

} 

CheckDelta { 
Active { P } 
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Divergence { 0.100000 } 

} 

} 

EtaCtrl { 
Mode { 
sel EtaSchedule 
EtaSchedule { 

SwitchTime { 10 } 
ReductFactor { 0.950000 } 

FuzzCtrl { 

MaxDeltaObj { 0. 300000 } 
MaxDelta20bj { 0.300000 } 
MaxEtaChange { 0.020000 } 
MinEta { 0.001000 } 
MaxEta { 0.100000 } 
Smoother { 1.000000 } 

} 

} 

Active { F } 

} 

LeamAlgo { 
sel OnlineBackProp 
VarioEta { 

MinCalls { 50 } 

} 

MoTnentuniBackProp { 
Alpha { 0.050000 } 

} 

Quickprop { 

Decay { 0.050000 } 
Mu { 2.000000 } 

} 

} 

Any Save { 

file_naTne { f , Stochastic.dat } 

) 

AnyLoad { 

file_nanie { f , Stochastic, dat } 

} 

BatchSize { 1 } 
Eta { 0.001000 } 
DerivEps { 0 . 000000 } 

} 

TrueBatch { 

PatternSelection { 
sel Sequential 
SubSample { 

Percent { 0.500000 } 

} 

ExpRandom { 

Lambda { 2.000000 } 

} 

} 

WtPruneCtrl { 
Tracer { 

Active { F } 

Set { Validation } 

File { trace } 

} 

Active { F } 
Randomize { 0.000000 } 
PruningSet { Train. +Val id. } 
Method { S- Pruning } 

} 

EtaCtrl { 

Active { F } 

} 

LearnAlgo { 
sel VarioEta 
VarioEta { 

MinCalls { 200 } 

} 

MomentumBackProp { 
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Alpha { 0.050000 } 

) 

Quickprop { 

Decay { 0.050000 } 
Mu { 2.000000 } 

} 

} 

AnySave { 

file_name { f.TrueBatch.dat } 



AnyLoad { 

file_name { f.TrueBatch.dat } 

} 

Eta { 0.050000 } 
15 DerlvBps { 0.000000 } 

} 

LineSearch { 

PattemSelection { 
sel Sequential 
20 SubSaraple { 

Percent { 0.500000 } 

} 

ExpRandom { 

Lambda { 2.000000 } 

25 } 

} 

yis Wt Prune Ctrl { 

1:::?;^ Tracer { 

Active { F } 
Cj 3 0 Set { Validation } 

= File { trace } 

Active { F } 
f=l Randomize { 0.000000 } 

3 5 PruningSet { Train .+Val id. } 

Method { S- Pruning } 

LearnAlgo { 
= sel Con j Gradient 

m 40 VarioEta { 

MinCalls { 200 } 

HI } 

r{| MomentumBackProp { 

Alpha { 0.050000 } 

45 } 

O Quickprop { 

rf Decay { 0.050000 } 

r^^, Mu { 2.000000 } 

50 Low- Memory -BFGS { 

Limit { 2 } 

} 

} 

AnySave { 

55 file_name { f.LineSearch.dat } 

} 

AnyLoad { 

file_name { f.LineSearch.dat } 

60 EtaNull { 1.000000 } 

MaxSteps { 10 } 
LS_Precision { 0.500000 } 
TrustRegion { T } 
DerivEps { 0.000000 } 

65 BatchSize { 2147483647 } 

} 

GeneticWeightSelect { 
PattemSelection { 
sel Sequential 
70 SubSample { 

Percent { 0.500000 } 

} 

ExpRandom { 

Lambda { 2.000000 } 
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} 

} 

LearnAlgo { 
sel VarloEta 
VarioEta { 

MinCalls { 200 } 

} 

MomentumBackProp { 
Alpha { 0.050000 } 

} 

} 

ObjFctTracer { 
Active { F } 
File { objFunc } 

} 

SearchControl { 
SearchStrategy { 
sel HillClimberControl 
HillClimberControl { 

%InitialAlive { 0.950000 } 
Inherit Weights { T } 
Beta { 0.100000 } 

MutationType { DistributedMacroMutation 
MaxTrials { 50 } 

} 

PBILControl { 

%InitialAlive { 0.950000 } 
InheritWeights { T } 
Beta { 0.100000 } 
Alpha { 0.100000 } 
PopulationSize { 40 } 

) 

PopulationControl { 

pCrossover { 1.000000 } 
CrossoverType { SimpleCrossover } 
Scaling { T } 

ScalingFactor { 2.000000 } 
Sharing { T } 

SharingFactor { 0.050000 } 
PopulationSize { 50 } 
rain. %InitialAlive { 0.010000 } 
max. % Initial Alive { 0.100000 } 

} 

} 

pMutation { 0.000000 } 

} 

ObjectiveFunctionWeights { 
%Alive { 0.600000 } 
E{TS) { 0.200000 } 
Improvement (TS) { 0.00000 0 } 
E(VS) { 1.000000 } 
Improvement (VS) { 0.00 0000 } 
{E(TS)-E(VS) )/max{E(TS) ,E(VS)) { 0.000000 } 
LipComplexity { 0.000000 } 
OptComp laxity { 2.000000 } 
testVal (dead) -testVal (alive) { 0.000000 } 

} 

AnySave { 

file_name { f.GeneticWeightSelect.dat } 

} 

AnyLoad { 

file_narae { f.GeneticWeightSelect.dat } 

} 

Eta { 0.050000 } 
DerivEps { 0.000000 } 
BatchSize { 5 } 

#minEpoGhsForFitnessTest { 2 } 
#maxEpochsForFitnessTest { 3 } 
SelectWeights { T } 
SelectNodes { T } 
maxGrowthOfVal Error { 0.005000 } 

} 

} 

CCMenu { 
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Clusters { 
mlp . input { 
ActFunction { 
sel id 
plogistic { 

parameter { 0.500000 } 

} 

ptanh { 

parameter { 0.500000 } 

} 

pid { 

parameter { 0.500000 } 

} 

} 

InputModif ication { 
sel None 

Adapt i veUni f ormNoi se { 
NoiseEta { 1.000000 } 
DampingFactor { 1.000000 } 

} 

Adapt iveGaussNoise { 
NoiseEta { 1.000000 } 
DampingFactor { 1.000000 } 

} 

FixedUnif ormNoise { 
SetNoiseLevel { 

NewNoiseLevel { 1.045229 } 

} 

} 

FixedGaussNoise { 
SetNoiseLevel { 

NewNoiseLevel { 1.045229 } 

} 

} 

} 

SaveNoiseLevel { 

Filename { noise_level.dat } 

} 

LoadNoiseLevel { 

Filename { noise_level.dat } 

} 

SaveManipulatorData { 

Filename { inputManip.dat } 

} 

LoadManipulatorData { 

Filename { inputManip.dat } 

} 

Norm { NoNorm } 

} 

mlp. excess Demand { 
ActFunction { 
sel id 

plogistic { 

parameter { 0,500000 } 

} 

ptanh { 

parameter { 0.500000 } 

} 

pid { 

parameter { 0,500000 } 

) 

} 

} 

mlp. price { 
ActFunction { 
sel id 
plogistic { 

parameter { 0.500000 } 

) 

ptanh { 

parameter { 0,500000 } 

} 

pid { 

parameter { 0.500000 } 
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} 

} 

ErrorFunc { 
sel LnCosh 
ix| { 

parameter { 0.050000 } 

} 

LnCosh { 

parameter { 2.000000 } 

} 

} 

ToleranceFlag { F } 
Tolerance { 0.000000 } 
Weighting { 2.000000 ) 

} 

mlp . agents { 
Act Function { 
sel tanh 
plogistic { 

parameter { 0.500000 } 

} 

ptanh { 

parameter { 0.500000 } 

} 

pid { 

parameter { 0.500000 } 

) 

} 

ErrorFunc { 
sel Prof Max 
|x| { 

parameter { O.OSOOOO ) 

} 

LnCosh { 

parameter { 2.000000 } 

} 

) 

Norm { NoNorm } 





ToleranceFlag { F } 
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0.100000 0.100000 0.100000 0.100000 

0.100000 0.100000 0.100000 0.100000 

0.100000 0.100000 0.100000 0.100000 

0.100000 0.100000 0.100000 0.100000 

0.100000 0.100000 0.100000 0.100000 

0.100000 0.100000 0.100000 0.100000 

0.100000 0.100000 } 

} 

} 

Connectors { 

mlp. agent s->excessDemand { 
WeightWatcher { 
Active { T } 
MaxWeight { 1.000000 } 
MinWeight { 1.000000 } 

} 

LoadWeightsLocal { 
Filename { std ) 

} 

Save Weights Local { 
Filename { std ) 

} 

Alive { T } 
Wt Freeze { F } 

AllowGeneticOptimization { F } 
Penalty { NoPenalty } 
AllowPruning { F } 
EtaModifier { 1.000000 ) 

} 

mlp. excessDemand->price { 
WeightWatcher { 
Active { T } 
MaxWeight { 2,000000 } 
MinWeight { 0.010000 } 

} 

LoadWeightsLocal { 
Filename { std } 

} 

SaveWeightsLocal { 
Filename { std } 

} 

Alive { T } 
WtFreeze { F } 

AllowGeneticOptimization { F } 
Penalty { NoPenalty } 
AllowPruning { F ) 
EtaModifier { 1.000000 } 

) 

mlp. input -> agents { 
WeightWatcher { 
Active { F } 
MaxWeight { 1.000000 ) 
MinWeight { 0.000000 } 

} 

LoadWeightsLocal { 
Filename { std } 

) 

SaveWeightsLocal { 
Filename { std } 

} 

Alive { T } 
WtFreeze { F } 

AllowGeneticOptimization { F } 
Penalty { NoPenalty } 
AllowPruning { T } 
EtaModifier { 1.000000 } 

} 

mlp .bias- >agents { 
WeightWatcher { 
Active { F } 
MaxWeight { 1.000000 } 
MinWeight { 0.000000 } 

LoadWeightsLocal { 
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Filename { std } 

) 

SaveWeightsLocal { 
Filename { std } 

} 

Alive { T } 
Wt Freeze { F } 
AllowGeneticOptimization { 
Penalty { NoPenalty } 
AllowPruning { F } 
EtaModifier { 1.000000 } 

} 

) 

AnySave { 

file_name { f.CCMenu.dat } 

) 

Anylioad { 

£ile_name { f.CCMenu.dat } 

) 

} 

Test Run { 

Filename { Test } 
Part .Transformed { F } 

) 

Online { 

Filename { Online.dat } 

} 

} 



FuT die Testphase: 

BpNet { 
Globals { 
Wt Penalty { 
sel NoPenalty 
Weigend { 

Lambda { 0.000000 } 
AutoAdapt { T } 
wO { 1.000000 } 
DeltaLambda { 0.000001 } 
ReducFac { 0.900000 } 
Gamma { 0.900000 } 
DesiredError { 0.000000 } 

} 

WtDecay { 

Lambda { 0.010000 } 
AutoAdapt { F } 
AdaptTime { 10 } 

EpsObj { 0.001000 } 
Ob] Set { Training } 
EpsilonFac { l.OOOOOO } 

} 

ExtWtDecay { 

Lambda { 0.001000 } 
AutoAdapt { F } 
AdaptTime { 10 } 
EpsObj { 0.001000 } 
Ob j Set { Training } 
EpsilonFac { 1.000000 ) 

} 

Finnoff { 

AutoAdapt { T ) 
Lambda { 0.000000 } 
DeltaLambda { 0.000001 } 
ReducFac { 0.900000 } 
Gamma { 0.900000 } 
DesiredError { 0.000000 } 

} 

} 

ErrorFunc { 
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sel LnCosh 
|xi { 

parameter { 0.050000 } 

} 

LnCosh { 

parameter { 2.000000 } 

} 

} 

Any Save { 

file_name { f.Globals.dat } 

} 

AnyLoad { 

file_name { f.Globals.dat } 

} 

ASCII { T ,} 

} 

LearnCtrl { 
sel Stochastic 
Stochastic { 

PatternSelection { 
sel Permute 
SubSample { 

Percent { 0.500000 } 

} 

Ei^Random { 

Lambda { 2.000000 } 



4 } 
0 



WtPruneCtrl { 

PruneSchedule { 
sel FixSchedule 
FixSchedule { 
Limit_0 { 10 } 
Limit_l { 10 } 
Limit_2 { 10 } 
Limit_3 { 10 } 
Repeat La St { T } 

} 

DynSchedule { 
MaxLength { 
MinimumRuns { 0 } 
Training { F } 
Validation { T } 
Generalization { F ) 

} 

DivSchedule { 

Divergence { 0.100000 
MinEpochs { 5 } 

} 

} 

PruneAlg { 
sel FixPrune 
FixPrune { 

Perc_0 { 0.100000 } 
Perc_l { 0,100000 } 
Perc_2 { 0.100000 } 
Perc_3 { 0.100000 } 

} 

EpsiPrune { 

DeltaEps { 0.050000 } 
StartEps { 0.050000 } 
1. 



} 



MaxEps 
ReuseEps { 



.000000 
F } 



} 

Tracer { 

Active { F } 

Set { Validation } 

File { trace } 

} 

Active { F } 
Randomize { 0.0 00000 } 
PruningSet { Train . +Valid . 
Method { S- Pruning ) 
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StopControl { 
EpochLimit ( 
Active { F } 
MaxEpoch { 60 } 

} 

MovingExpAverage { 
Active { F } 
MaxLength { 4 } 
Training { F } 
Validation { T } 
Generalization { F } 
Decay { 0.900000 } 

} 

CheckObjectiveFct { 
Active { F } 
MaxLength { 4 } 
Training { F } 
Validation { T } 
Generalization { F } 

} 

CheckDelta { 
Active { F } 
Divergence { 0.100000 } 

} 

} 

EtaCtrl { 
Mode { 
sel EtaSchedule 
EtaSchedule { 

SwitchTime { 10 } 
ReductFactor { 0.950000 } 

} 

FuzzCtrl { 

MaxDeltaObj { 0.300000 } 
MaxDelta20bj { 0.300000 } 
MaxEtaChange { 0.020000 } 
MinEta { 0.001000 } 
MaxEta { 0.100000 } 
Smoother { 1.000000 } 

} 

} 

Active { F } 

} 

LearnAlgo { 
sel VarioEta 
VarioEta { 

MinCalls { 50 } 

} 

MomentumBackProp { 
Alpha { 0.050000 } 

} 

Quickprop { 

Decay { 0.050000 } 
Mu { 2.000000 } 

} 

} 

AnySave { 

file_name { f.Stochastic.dat } 

} 

AnyLoad { 

file__name { f.Stochastic.dat } 

} 

BatchSize { 10 } 
Eta { 0.010000 } 
DerivEps { 0.010000 } 

) 

TrueBatch { 

PatternSelection { 
sel Sequential 
SubSample { 

Percent { 0.500000 } 

} 

ExpRandom { 
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Lambda { 2,000000 ) 

) 

} 

WtPruneCtrl { 
Tracer { 

Active { F } 

Set { Validation } 

File { trace } 

} 

Active { F } 
Randomize { 0.0000 00 } 
PruningSet { Train. +Valid. } 
Method { S- Pruning } 

} 

EtaCtrl { 
Active { F } 

} 

LearnAlgo { 
sel VarioEta 
VarioEta { 

MinCalls { 200 } 

} 

MomentumBackProp { 
Alpha { 0.050000 } 

) 

Quickprop { 

Decay { 0.050000 } 
Mu { 2.000000 } 

} 

) 

AnySave { 

f i 1 e_name { f . TrueBa t ch . dat } 

} 

AnyLoad { 

file_name { f.TrueBatch.dat } 

} 

Eta { 0.050000 } 
DerivEps { 0.010000 } 

} 

LineSearch { 

PatternSelection { 
sel Sequential 
SubSample { 

Percent { 0.500000 ) 

} 

ExpRandom { 

Lambda { 2.000000 } 

} 

} 

WtPruneCtrl { 
Tracer { 

Active { F } 

Set { Validation } 

File { trace } 

} 

Active { F } 
Randomize { 0.000000 } 
PruningSet { Train. +Valid. } 
Method { S- Pruning } 

} 

LearnAlgo { 
sel Con j Gradient 
VarioEta { 

MinCalls { 200 } 

} 

MomentumBackProp { 
Alpha { 0.050000 } 

) 

Quickprop { 

Decay { 0.050000 } 
Mu { 2.000000 } 

} 

Low- Memory -BFGS { 
Limit { 2 } 
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} 

} 

AnySave { 

file_name { f .LineSearch.dat } 

} 

AnyLoad { 

file_name { f.LineSearch.dat } 

} 

EtaNull { 1.000000 } 
MaxSteps { 10 } 
LS_Precision { 0.500000 } 
TrustRegiorx { T } 
DerivHps { 0.0100 00 } 
BatchSize { 2147483647 } 

} 

Genet icWeightSelect { 
PatternSelection { 
sel Sequential 
SubSample { 

Percent { 0.500000 } 

} 

ExpRandom { 

Lambda { 2.000000 } 

} 

} 

LearnAlgo { 
sel VarioEta 
VarioEta { 

MinCalls { 200 } 

} 

MomenCumBackProp { 
Alpha { 0.050000 } 

} 

} 

ObjFctTracer { 
Active { F } 
File { objFunc } 

} 

SearchControl { 
SearchStrategy { 
sel HillClinnberControl 
HillClitnberControl { 

%InitialAlive { 0.950000 } 
InheritWeights { T } 
Beta { 0.100000 } 

MutationType { DistributedMacroMutation 
MaxTrials { 50 } 

} 

PBILControl { 

%InitialAlive { 0.950000 } 
InheritWeights { T } 
Beta { 0.100000 } 
Alpha { 0.100000 } 
PopulationSize { 40 } 

} 

PopulationControl { 

pCrossover { 1.000000 } 
CrossoverType { SimpleCrossover } 
Scaling { T } 

ScalingFactor { 2.000000 } 
Sharing { T } 

SharingFactor { 0.050000 } 
PopulationSize { 50 } 
min.%InitialAlive { 0.010000 } 
max.%InitialAlive { 0.100000 } 

} 

} 

pMutation { 0.000000 } 

ObjectiveFunctionWeights { 
%Alive { 0.600000 } 
E(TS) { 0.200000 } 
Improvement (TS) { 0.00000 0 } 
E(VS) { 1.000000 } 
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Improvement (VS) { 0.000000 } 
(E(TS) -E(VS) )/max{E(TS) ,E(VS) ) { 0.000000 
LipComplexity { 0.000000 } 
OptComplexity { 2.000000 ) 
testVal (dead) -testVaK alive) { 0.000000 } 

} 

Any Save { 

file_name { f.GeneticWeightSelect.dat } 

} 

AnyLoad { 

file_name { f.GeneticWeightSelect.dat } 

) 

Eta { 0.050000 } 
DerivEps { 0.010000 } 
BatchSize { 5 } 

#minEpochsForFitnessTest { 2 } 
#maxEpochsForFitnessTest { 3 } 
SelectWeights { T } 
SelectNodes { T } 
maxGrowthOfValError { 0.005000 } 

} 

} 

CCMenu ( 
Clusters { 
mlp.inputPl { 
Act Function { 
sel id 
plogistic { 

parameter { 0.500000 } 

} 

ptanh { 

parameter { 0.500000 } 

} 

pid { 

parameter { 0.500000 } 

) 

} 

InputModif ication { 
sel None 

Adapt iveUniformNoise ( 
NoiseEta { 1.000000 } 
Dait^jingFactor { 1.000000 } 

} 

Adapt iveGaussNoise { 
NoiseEta { 1.000000 } 
DampingFactor { 1.000000 } 

} 

FixedUniformNoise { 
SetNoiseLevel { 

NewNoiseLevel { 0.000000 } 

} 

} 

FixedGaussNoise { 
SetNoiseLevel { 

NewNoiseLevel { 0.000000 } 

} 

) 

} 

SaveNoiseLevel { 

Filename { noise_level.dat } 

} 

LoadNoiseLevel { 

Filename { noise_level.dat } 

} 

SaveManipulatorData { 

Filename { inputManip.dat } 

} 

LoadManipulatorData { 

Filename { inputManip.dat } 

} 

Norm { NoNorm } 

} 

mlp . input { 
Act Function { 
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sel id 
plogistic { 

parameter { 0.500000 } 

} 

ptanh { 

parameter { 0.500000 } 

} 

pid { 

parameter { 0.500000 } 

} 

} 

InputModif ication { 
sel None 
Adapt iveUniformNoise { 
NoiseEta { 1.000000 } 
DampingFactor { 1.000000 ) 

} 

Adapt iveGaussNoise { 
NoiseEta { 1.000000 } 
DampingFactor { 1.000000 ) 

} 

FixedUniformNoise { 
SetNoiseLevel { 

NewNoiseLevel { 0,000000 } 

} 

} 

FixedGaussNoise { 
SetNoiseLevel { 

NewNoiseLevel { 0.000000 } 

) 

} 

) 

SaveNoiseLevel { 

Filename { noise_level.dat } 

} 

LoadNoiseLevel { 

Filename { noise_level.dat } 

} 

SaveManipulatorData { 

Filename { inputMcuiip.dat } 

} 

LoadManipulatorData { 

Filename { inputManip.dat } 

) 

Norm { NoNorm } 

} 

mlp. agents PI { 
ActFunction { 
sel id 
plogistic { 

parameter { 0.500000 } 

} 

ptanh { 

parameter { 0.500000 } 

} 

pid { 

parameter { 0.500000 } 

} 

} 

ErrorFunc { 
sel none 
|x| { 

parameter { 0.050000 } 

} 

LnCosh { 

parameter { 2.000000 } 

) 

} 

Norm { NoNorm } 
ToleranceFlag { F } 

Tolerance { 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 
0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 
0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 
0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 
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} 

mlp. agents { 
ActFunction { 
sel tanh 
plogistic { 

parameter { 0.500000 } 

} 

ptanh { 

parameter { 0.500000 } 

} 

Pid { 

parameter { 0.500000 } 

} 

} 

Error Func { 
sel ProfMax 

|xi { 

parameter 



0.050000 } 
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LnCosh { 

parameter { 2.000000 } 

} 

) 

Norm { NoNorm } 
ToleranceFlag { F } 
Tolerance { 0.000000 0.000000 
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} 

mlp . excessDemand { 
ActFunction { 
sel id 
plogistic { 

parameter { 0.500000 } 

} 

ptanh { 

parameter { 0.500000 } 

} 

pid { 



} 



parameter { 0.500000 } 



) 

} 

mlp. price { 
ActFunction { 
sel id 
plogistic { 

parameter { 0.500000 } 

} 

ptanh { 

parameter { 0,500000 } 

} 

pid { 

parameter { 0.500000 } 

} 

} 

ErrorPunc { 
sel LnCosh 
|x| { 

parameter { 0.050000 } 

} 

LnCosh { 

parameter { 2.000000 } 

} 

} 

ToleranceFlag { F } 
Tolerance { 0.000000 } 
Weighting { 1.000000 } 

} 



} 

Connectors { 
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mlp. inputPl->agentsPl { 
WeightWatcher { 
Active { F } 
MaxWeight { 1.000000 } 
5 MinWeight { 0.000000 } 

} 

LoadWeightsLocal { 
Filename { std } 

10 SaveWeightsLocal { 

Filename { std } 

} 

Alive { T } 
WtFreeze { F } 
15 AllowPruning { T } 

; EtaModifier { 1.000000 } 

Penalty { NoPenalty } 

} 

mlp. bias ->agentsPl { 
• 1:* 20 WeightWatcher { 

?L Active { F } 

MaxWeight { 1.000000 } 
MinWeight { 0.000000 ) 

25 LoadWeightsLocal { 

Filename { std } 

p } 

SaveWeightsLocal { 
'SJ!" Filename { std } 

P 30 } 

Alive ( T } 
WtFreeze { F } 
AllowPruning { F } 
Q EtaModifier { 1.000000 } 

35 Penalty { NoPenalty } 

ill mlp . input - > agents { 

LoadWeightsLocal { 
~ Filename { std } 

Mi. 40 } 

fj = SaveWeightsLocal { 

'-'^^ Filename { std } 

ril ) , , 

rB Alive { T } 

i! 45 WtFreeze { F } 

AllowPruning { T } 
EtaModifier { 1.000000 } 
Penalty { NoPenalty } 

50 mlp. bias ->agents { 

LoadWeightsLocal { 
Filename { std } 

} 

SaveWeightsLocal { 
55 Filename { std } 

} 

Alive { T } 
WtFreeze { F } 
AllowPruning { F } 
60 EtaModifier { 1.000000 } 

Penalty { NoPenalty } 

mlp. agents PI ->agents { 
WeightWatcher { 
65 Active { F } 

MaxWeight { 1.000000 } 
MinWeight { 0.000000 } 

} 

LoadWeightsLocal { 
70 Filename { std } 

} 

SaveWeightsLocal { 
Filename { std } 
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Alive { T } 
WtFreeze { F } 
AllowPruning { F } 
Penalty { NoPenalty } 
EtaModifier { 1.000000 } 

) 

mlp. agent s->excessDemand { 
WeightWatcher { 
Active { T } 
MaxWeight { 1.000000 } 
MinWeight { 1.000000 } 

} 

LoadWeightsLocal { 
Filename { std } 

} 

SaveWeightsLocal { 
Filename { std } 

} 

Alive { T } 
WtFreeze { T } 
AllowPruning { F } 
Penalty { NoPenalty } 
EtaModifier { 1.000000 ) 

} 

mlp.excessDemand->price { 
WeightWatcher { 
Active { T } 
MaxWeight { 2.000000 } 
MinWeight { 0.0100 00 } 

} 

LoadWeightsLocal { 
Filename { std } 

} 

SaveWeightsLocal { 
Filename { std } 

} 

Alive { T } 
WtFreeze { F } 
AllowPruning { F } 
Penalty { NoPenalty } 
EtaModifier { 1.000000 } 

} 

} 

AnySave { 

file_name { f.CCMenu.dat } 

} 

AnyLoad { 

file_name { f.CCMenu.dat } 

} 

} 

Test Run { 

Filename { Test } 
Part .Transformed { F } 

} 

Online { 

Filename { Online.dat ) 



} 



2 . Spezif ikations-Datei : 

APPLI CATION Dollar__Prognose_Grimmdat en 

MODE DAY WEEK 5 

FROM 01.01.1991 TO MAX 

TRAINING FROM 01.01.1991 TO 03.09.1996 
VALIDATION FROM 03.09.1995 TO 03.09.1996 
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// VALIDATION RANDOM 0% 



INPUT CLUSTER mlp.inputPl 

BEGIN DBMUSD "DMARKER/USDOLLR" 
X = FILE data/dol.txt COLUMN 1 

INPUT = scale ((x -x{-l)) /x(-l)) 
LAG -1 

INPUT = scale {(x - 2 * x{-l) + x{-2)) / x) 
LAG -1 

END 



BEGIN JPYUSD " JAPAYEN/USDOLLR" 
X = FILE data/dol.txt COLUMN 2 

INPUT = scale ((x - x{-l)) / x(-l}) 
LAG -1 

INPUT = scale ((x - 2 * x(-l) + x(-2)) / x) 
LAG -1 

END 



BEGIN ECUS3M "EURO-CURRENCY (LDN) US$ 3 MONTHS - MIDDLE RATE" 
X « FILE data/dol.txt COLUMN 3 

INPUT = scale ((x - x(-l)) / x(-l)) 
LAG -1 

INPUT = scale((x - 2 * x(-l) + x(-2)) / x) 
LAG -1 

END 



BEGIN ECWGM3M "EURO-CURRENCY (LDN) D-MARK 3 MONTHS - MIDDLE RATE" 
x = FILE data/dol.txt COLUMN 4 

INPUT = scale{(x - x(-l)) / x(-l)) 
LAG -1 

INPUT = scale((x - 2 * x(-l) + x(-2)) / x) 
LAG -1 

END 



BEGIN AUSGVG4RY "US TOTAL 7-10 YEARS DS GOVT. INDEX - RED. YIELD" 
X = FILE data/dol.txt COLUMN 5 

INPUT = scale ((x - x{-l)) / x(-l)) 
LAG -1 

INPUT = scale ((x - 2 * x(-l) + x{-2)) / x) 
LAG -1 

END 



BEGIN ABDGVG4RY "BD TOTAL 7-10 YEARS DS GOVT. INDEX - RED. YIELD" 
X = FILE data/dol.txt COLUMN 6 

INPUT = scale((x - x(-l)) / x(-l)) 
LAG -1 

INPUT = scale ((x - 2 * x(-l) + x(-2)) / x) 
LAG -1 

END 



BEGIN AJPGVG4RY "JP TOTAL 7-10 YEARS DS GOVT. INDEX - RED. YIELD" 
X = FILE data/dol.txt COLUMN 7 

INPUT = scale ({x - x(-l)) / x(-l)) 

LAG -1 

INPUT = scale ((x - 2 * x(-l) + x{-2)) / x) 
LAG -1 

END 
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BEGIN TOTMKUSRI "US-DS MARKET - TOT RETURN IND" 
X = FILE data/dol.txt COLUMN 8 

INPUT = scale((x - x(-l)) / x(-l)) 
LAG -1 

INPUT = scale((x - 2 * x(-l) + x(-2)) / x) 
LAG -1 

END 



BEGIN TOTMKBDRI "GERMANY-DS MARKET - TOT RETURN IND" 
X = FILE data/dol.txt COLUMN 9 

INPUT = scale((x - x(-l)) / x(-l)) 
LAG -1 

INPUT = scale((x - 2 * x(-l) + x(-2)) / x) 
LAG -1 

END 



BEGIN NYFECRB "COMMODITY RESEARCH BUREAU INDEX-CRB - PRICE INDEX" 
x « FILE data/dol.txt COLUMN 10 

INPUT = scale ((x - x(-l)) / x{-l)) 
LAG -1 

INPUT = scale ((x - 2 * x{-l) + x{-2)) / x) 
LAG -1 

END 



BEGIN GOLDBLN "GOLD BULLION $/TROY OUNCE" 
X = FILE data/dol.txt COLUMN 11 

INPUT = scale ((x - x{-l)) / x(-l)) 
LAG -1 

INPUT ^ scale ({x - 2 * x(-l) + x{-2)) / x) 
LAG -1 

END 



INPUT CLUSTER mlp. input 

BEGIN DEMUSD "DMARKER/USDOLLR" 
x = FILE data/dol.txt COLUMN 1 

INPUT - scale ((x - x{-l)) / x(-l)) 

INPUT = scale ((x - 2 * x(-l) + x(-2)) / x) 

END 



BEGIN JPYUSD " JAPAYEN/USDOLLR" 
x = FILE data/dol.txt COLUMN 2 

INPUT = scale((x - x(-l)) / x{-l)) 

INPUT = SGale((x - 2 * x(-l) + x(-2)) / x) 

ElOD 



BEGIN ECUS3M "EURO-CURRENCY (LDN) US$ 3 MONTHS - MIDDLE RATE" 
X = FILE data/dol.txt COLUMN 3 

INPUT = scale{(x - x(-l)) / x{-l)) 

INPUT = scale((x - 2 * x(-l) + x(-2)) / x) 

END 



BEGIN ECWGM3M "EURO-CURRENCY (LDN) D-MARK 3 MONTHS - MIDDLE RATE" 
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X FILE data/dol.txt COLUMN 4 

INPUT « scale((x - x(-l)) / x(-l)) 

INPUT = scale({x - 2 * x(-l) + x(-2)) / x) 

END 



BEGIN AUSGVG4Ry "US TOTAL 7-10 YEARS DS GOVT. INDEX - RED. YIELD" 
X = FILE data/dol.txt COLUNN 5 

INPUT = scale {(x - x{-l)) / x(-l)) 

INPUT = scale ((x - 2 * x(-l) + x(-2)) / x) 

END 



BEGIN ABDGVG4RY "BD TOTAL 7-10 YEARS DS GOVT. INDEX - RED. YIELD" 
x = FILE data/dol.txt COLUMN 5 

INPUT = scale((x - x(-l)) / x(-l)) 

INPUT = scale((x - 2 * x(-l) + x{-2)) / x) 

END 



BEGIN AJPGVG4RY "JP TOTAL 7-10 YEARS DS GOVT. INDEX - RED. YIELD" 
X = FILE data/dol.txt COLUMN 7 

INPUT = scale ((x - xC-1)) / x(-l}) 

INPUT = scale ((x - 2 * x(-l) + x(-2)) / x) 



BEGIN TOTMKUSRI "US-DS MARKET - TOT RETURN IND" 
X = FILE data/dol.txt COLUMN 8 

INPUT ^ scale(Cx - x(-l)) / x{-l)) 

INPUT = scale ((x - 2 * x(-l) + x{-2)) / x) 

END 



BEGIN TOTMKBDRI " GERMANY -DS MARKET - TOT RETURN IND" 
x = FILE data/dol.txt COLUMN 9 

INPUT = scale((x - x(-l)) / x(-l)) 

INPUT « scale((x - 2 * x(-l) + x(-2)) / x) 

END 



BEGIN NYFECRB "COMMODITY RESEARCH BUREAU INDEX-CRB - PRICE INDEX" 
x = FILE data/dol.txt COLUMN 10 

INPUT = scale{(x - x(-l)) / x(-l)) 

INPUT = scale ((x - 2 * x(-l) + x(-2)) / x) 

END 



BEGIN GOLDBLN "GOLD BULLION $/TROY OUNCE" 
X = FILE data/dol.txt COLUMN 11 

INPUT = scale {(x - x(-l)) / x(-l)) 

INPUT = scale ((x - 2 * x(-l) + x(-2)) / x) 
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TARGET CLUSTER mlp. agent sPl 

BEGIN agents behavior past 1 

X = FILE data/dol.txt COLUMN 1 
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TARGET 

TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 



100 

100 
100 
100 
100 
100 
100 
100 



ln{x / x(-l)) 

ln(x / x(-l) ) 

ln{x / x(-l)) 

ln{x / x(-l)) 

ln(x / x(-l)) 

ln(x / x(-l)) 

ln(x / x(-l) ) 

ln(x / x(-l) ) 



100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 

100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 



ln(x / 
ln{x / 
ln(x / 
ln(x / 
ln(x / 
ln(x / 
ln(x / 
ln(x / 
ln(x / 
ln(x / 



x(-l)) 
x(-l)) 
x{-l) ) 
x(-l) ) 
x(-l)) 
x(-l)) 
x{-l)) 
x{-l)) 
x(>l)) 
x(-l)) 



ln(x 
ln(x 
ln{x 
ln{x 

ln(x 
ln(x 
ln(x 
ln(x 
ln{x 
ln(x 



/ x{-l)) 
/ x(-l)) 
/ x(-l)) 
/ x(-l)) 

/ x(-l)) 
/ x(-l)) 
/ x(-l)) 
/ x(-l)) 
/ x(-l}) 
/ x(-l)) 



35 



40 



TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 



100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 



ln(x / 
ln(x / 
ln(x / 
ln(x / 
ln(x / 
ln(x / 
ln(x / 
ln(x / 
ln{x / 
ln(x / 



x(-l)) 
x(-l)) 
x(-l)) 
x{-l)) 
x(-l)) 
x(-l)) 
x(-l)) 
x{-l)) 
x(-l)) 
x(-l)) 



45 



50 



55 



TARGET 
TARGET 

TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 



100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 



ln(x / 
ln(x / 
ln(x / 
ln{x / 
ln(x / 
ln(x / 
ln(x / 
ln(x / 
ln(x / 
ln(x / 



x(-l)) 
x{-l) ) 
x{-l) ) 
x(-l)) 
x(-l)) 
x(-l)) 
x(-l)) 
x(-l)) 
x(-l)) 
x{-l)) 



60 



65 



TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 



100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 
100 * 



ln(x / 
ln(x / 
ln(x / 
ln(x / 
ln(x / 
ln{x / 
ln(x / 
ln(x / 
ln{x / 
ln(x / 



x(-l)) 
x(-l)) 
x(-l)) 
x(-l)) 
x(-l)) 
x(-l)) 
x(-l)) 
x{-l)) 
x(-l)) 
x(-l)) 



70 



TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 
TARGET 



100 
100 
100 
100 
100 
100 
100 



ln(x / x(-l)) 

ln(x / x(-l)) 

ln(x / x{-l)) 

ln(x / x(-l)) 

ln{x / x(-l)) 

ln(x / x(-l)) 

ln(x / x(-l)) 
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TARGET = 100 * ln(x / x{-l)) 
TARGET = 100 * ln(x / x(-l)) 
TARGET = 100 * ln(x / x(-l)) 

5 TARGET = 100 * ln{x / x(-l)) 

TARGET = 100 * ln{x / x(-l)) 
TARGET = 100 * ln(x / x(-l)) 
TARGET = 100 * ln(x / x(-l)) 
TARGET = 100 * In (x / x(-l)) 
10 TARGET = 100 * ln(x / x{-l)) 

TARGET = 100 * ln(x / x(-l)) 
TARGET = 100 * ln(x / x(-l)) 
TARGET = 100 * In (x / x(-l)) 
TARGET = 10 0 * In (x / x{-l)) 

15 

TARGET = 100 * In (x / x(-l)) 
TARGET = 100 * ln(x / x(-l)) 
TARGET = 100 * ln(x / x(-l)) 
TARGET = 100 * ln(x / x(-l)) 

20 TARGET = 100 * ln{x / x(-l)) 

TARGET = 100 * ln(x / x(-l)) 
TARGET = 100 * ln(x / x(-l)) 
TARGET = 100 * ln(x / x(-l)) 
TARGET = 100 * ln(x / x(-l)) 

25 TARGET = 100 * ln(x / x(-l)) 



TARGET = ICQ * In (x / x(-l)) 

TARGET = 100 * ln(x / x{-l)) 

30 TARGET = 100 * In (x / x(-l)) 

TARGET = 100 * ln(x / x(-l)) 

TARGET = 100 * ln(x / x{-l)) 

TARGET = 100 * ln(x / x(-l)) 

TARGET = 100 * ln(x / x(-l)) 

35 TARGET = 100 * ln(x / x(-l)) 

TARGET = 100 * ln(x / x(-l)) 

TARGET = 100 * ln(x / x{-l}) 

TARGET = 100 * ln{x / x(-l)) 

40 TARGET = 100 * ln(x / x(-l)) 

TARGET = 100 * ln(x / x(-l)) 

TARGET 100 * ln(x / x{-l)) 

TARGET = 100 * ln(x / x(-l)) 

TARGET = 100 * ln{x / x{-l)) 

45 TARGET = 100 * ln(x / x{-l)) 

TARGET = 100 * ln(x / x(-l) ) 

TARGET = 100 * ln(x / x(-l)) 

TARGET = 100 * ln(x / x(-l)) 

50 TARGET = 100 * ln(x / x(-l)) 

TARGET = 100 * ln{x / x(-l)) 
TARGET = 100 * In (x / x(-l)) 
TARGET = 100 * ln(x / x{-l)) 
TARGET = 100 * ln(x / x(-l)) 

55 TARGET = 100 * ln{x / x(-l)) 

TARGET = 100 * In (x / x{-l)) 
TARGET = 10 0 * In (x / x(-l)) 
TARGET = 100 * ln{x / x(-l)) 
TARGET = 100 * ln(x / x{-l)) 

60 

TARGET = 100 * ln(x / x(-l)) 
TARGET = 100 * ln(x / x(-l)) 
TARGET = 100 * ln{x / x(-l}) 
TARGET = 100 * InCx / x(-l)) 

65 TARGET = 100 * ln(x / x(-l)) 

TARGET - 100 * In (x / x(-l}) 
TARGET = 100 * ln(x / x{-l)) 
TARGET = 100 * ln(x / x(-l)) 
TARGET = 100 * In (x / x{-l)) 

70 TARGET = 100 * ln(x / x(-l)) 



TARGET = 100 * ln(x / x(-l)) 
TARGET = 100 * ln(x / x(-l)) 
TARGET = 100 * ln(x / x(-l)) 
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47 



TARGET 




100 


* 


ln{x 


/ 


x( 


-D) 


TARGET 




100 


* 


ln(x 


/ 


x( 


-D) 


TARGET 




100 


* 


ln(x 


/ 


x{ 


-D) 


TARGET 




100 


* 


ln(x 


/ 


x( 


-D) 


TARGET 




100 


* 


ln(x 


/ 


x( 


-D) 


TARGET 




100 


■k 


ln(x 


/ 


x( 


-D) 


TARGET 




100 


* 


ln(x 


/ 


x( 


-D) 



END 



TARGET CLUSTER mlp. agents 

BEGIN agents behavior 

X = FILE data/dol.txt COLUMN 1 



TARGET 




100 




in tx ^ 1 J 


/ X} 


TARGET 


= 


100 




in tx tl; 


/ •v\ 

/ y^i 


TARGET 


= 


100 




m ^x 1 1 / 


/ 


rn TK n/^ 1 .111 > 

TARGET 




100 




intxti; 


/ v\ 

/ 


TARGET 


_ 


100 


* 


ln(x(l) 


/ X) 


TARGET 


= 


100 


* 


ln(x(l) 


/ X) 


TARGET 




100 




in ^x ^ 1 ^ 


/ x; 


TARGET 




100 




In (x (1 ) 


/ x; 


TARGET 


— 


100 




In (x(l) 


/ X) 


TARGET 




100 




In (x (1) 


I xj 


TARGET 




100 




In (x ( 1) 


/ X} 


TARGET 




100 




In (x ( 1) 


/ x; 


TARGET 


- 


100 




In (x ( 1 ) 


/ x; 


TARGET 




ICQ 




In (x ( 1) 


1 x) 


TARGET 


: 


ICQ 


* 


ln{x(l) 


/ x) 


TARGET 


= 


100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


In (x ( 1) 


/ x) 


TARGET 




100 




ln(x{l) 


/ x) 


TARGET 


- 


100 


* 


In (x( 1) 


/ x) 


TARGET 




100 


* 


In (x(l) 


/ x) 


TARGET 




100 


* 


ln(x(l) 


/ x) 


TARGET 




100 


* 


ln{x(l) 


/ x) 


TARGET 




100 


* 


ln(x{l) 


/ x) 


TARGET 




100 


* 


ln(x(l) 


/ x) 


TARGET 


= 


100 


* 


ln{x(l) 


/ X) 


TARGET 




100 


* 


ln{x(l) 


/ x) 


TARGET 


= 


100 




ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ x) 


TARGET 




100 




ln{x{ 1) 


/ x) 


TARGET 




ICQ 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln{x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 




ln{x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln{x{l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 




ln(x(l) 


/ X) 


TARGET 




100 


* 


In(xCl) 


/ X) 


TARGET 




100 


* 


ln(x{l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln{x(l) 


/ x) 


TARGET 




100 


* 


ln(x{l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 
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10 



15 



20 



25 



30 



35 



40 



45 



50 



55 



60 



65 



70 



TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x{l} 


/ X) 


TARGET 




100 




ln(x{l) 


/ x) 


TARGET 




100 


* 


ln{x(l) 


/ x) 


TARGET 




100 


* 


ln(x(l) 


/ x) 


TARGET 




100 




ln(x(l) 


/ x) 


TARGET 




100 


* 


ln(x(l) 


/ x) 


TARGET 


= 


100 


★ 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ x) 


TARGET 




100 


* 


ln(x(l) 


/ x) 


TARGET 




100 


* 


ln(x(l) 


/ x) 


TARGET 




100 


* 


ln{x(l) 


/ x) 


TARGET 




100 


* 


ln(x(l) 


/ x) 


TARGET 




100 


* 


ln(x(l) 


/ x) 


TARGET 




100 


* 


ln(x{l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ x) 


TARGET 




100 


* 


ln(x(l) 


/ x) 


TARGET 


= 


100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x{l) 


/ x) 


T'ZV'Pfl'PIT' 

J. AAVJCtX 




100 


* 


ln(x(l) 


/ x) 






100 


* 


ln(x(l) 


/ x) 






100 


* 


ln{x{l) 


/ x) 


XAI%.V70 J. 




100 




ln(x(l) 


1 x) 






100 


* 


ln(x(l) 


/ x) 


TARGEtT 




100 


* 


ln(x (1) 


/ x) 






100 


* 


ln(x(l) 


/ x) 






100 


* 


ln(x(l) 


/ x) 


TARGET 




100 


* 


ln(x(l) 


/ x) 






100 


•k 


In (x ( 1 ) 


/ x) 


TARGET 




100 




ln(x(l) 


1 x) 






100 


* 


In (x(l) 


/ x) 


ii-UK-OH X 




100 


* 


In (x(l) 


/ x^ 






100 


* 


ln(x(l) 


1 xl 


T'7\ DnTTT 
IAKLjUi 1 




inn 
± u u 


ie 


111 \Ji. y ± ) 


/ x; 






inn 
J. u u 


it 


In (x ( 1) 


/ x; 






100 


•k 


In (x ( 1) 


/ x^ 
/ x; 






100 


* 


ln(x (1) 


/ ^1 


TARGET 


= 


100 


* 


ln{x(l) 


1 X) 






100 


* 


ln(x(l) 


/ x) 


TARGET 


= 


100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 






100 


* 


ln(x{l) 


/ x) 






100 


* 


In (x(l ) 


/ x) 


TARGET 




100 


* 


In (x(l) 


/ x) 


TARGET 




100 


* 


ln{x{l) 


/ x) 


Xr^xvkju 1 




100 


* 


ln(x{l) 


/ x) 






100 


it 


In (x ( 1) 


! x) 






1 on 


if 


xli VX ^ JL) 








100 


* 


In {x( 1) 








100 




In (x ( 1) 


/ ^1 


T R 13 ^3 Ij" 1 ' 




100 


* 


In (x ( 1 ) 


1 x) 






100 


n 


In (x(l) 


1 y:\ 


m ^ D /*< TTirp 




100 


•k 


ln(x(l) 


1 

/ -^i 


LnSSSsCi 1 




100 




In (x(l) 


I x) 


XXUXWCI X 




100 


* 


ln(x(l) 


/ x) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln{x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 




ln(x{l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x{l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 
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TARGET = 100 * ln(x(l) / x) 

TARGET * 100 * ln(x{l) / x) 

TARGET = 100 * ln(x(l) / x) 

5 TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln{x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

10 TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln{x(l) / x) 

TARGET = 100 * ln{x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

15 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

20 TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln{x{l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

25 TARGET = 100 * ln{x(l) / x) 

Uk TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

^ TARGET = 100 * ln(x(l) / x) 

l-sl 30 TARGET = 100 * ln(x(l) / x) 

Ul TARGET = 100 * ln(x{l) / x) 

TARGET = 100 * ln(x(l) / x) 

tfl TARGET = 100 * ln(x(l) / x) 

pi TARGET = 100 * ln{x(l) / x) 

35 TARGET = 100 * ln(x{l) / x) 

M TARGET = 100 * ln(x(l) / x) 



TARGET = 100 * ln(x(l) / x) 

40 TARGET = 100 * ln{x(l) / x) 

TARGET « 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x{l) / x) 

45 TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln{x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

50 TARGET = 100 * ln(x(l) / x) 

TARGET = lOO * ln(x(l) / x) 

TARGET = 100 * ln(x{l) / x) 

TARGET = 100 * lrL(x{l) / x) 

TARGET = 100 * ln(x(l} / x) 

55 TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln{x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

60 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x{l) / x) 

65 TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x{l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 10 0 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

70 TARGET = 100 * ln(x(l) / x) 



TARGET 
TARGET 
TARGET 



= 100 * ln(x(l) / x) 
= 100 * ln(x(l) / X) 
= 100 * ln(x(l) / X) 
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50 



TAR6EIT 




100 


* 


ln(x(l) 


/ x) 


TARGET 




100 


* 


ln(x(l) 


/ x) 


TARGET 




100 


* 


ln(x(l) 


/ x) 


TARGET 




100 


* 


ln(x(l) 


/ x) 






100 


* 


In (x (1) 


/ x) 


TARGET 




100 


* 


ln{x(l) 


f ^1 


TARGET 




100 


* 


ln{x(l) 


1 x) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x{l) 


/ x) 


TARGET 




100 


* 


ln(x(l} 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ x) 


TARGET 




100 


* 


ln(x{l) 


/ X) 


TARGET 




100 


■* 


ln(x{l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 



END 



TARGET CLUSTER mlp. price 

BEGIN price 

X = FILE data/dol . txt COLUMN 1 

TARGET = 100 * ln{x{l} / x) 
ASSIGN TO channel 

END 



SIGNAL 

BEGIN hit rate = NORMS UM (signal) 
t = TARGET channel 
o = OUTPUT channel 

SIGNAL = IF t * O > 0 THEN 1 ELSE 0 

END 



BEGIN Rol 

Y = FILE data/dol. txt COLUMN 1 
o = OUTPUT channel 

SIGNAL = (yd) / y - 1) * sign{o) 

END 



BEGIN realized potential = Relsum{signall, signal2) 
Y = FILE data/dol -txt COLUMN 1 
o = OUTPUT channel 

SIGNAL - (yd) / y - 1) * sign(o) 

SIGNAL = abs(y{l) / y - 1) 

END 



BEGIN Backtrans format ion of forecasts 
y = FILE data/dol. txt COLUMN 1 
o - OUTPUT channel 

SIGNAL = yd) 

SIGNAL = y * (1 + o / 100) 

END 



BEGIN Buy & Hold 

y = FILE data/dol. txt COLUMN 1 
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SIGNAL = yd) / y - 1 



END 



BEGIN Naiv Prognose 

y = FILE data/dol.txt COLUMN 1 

SIGNAL = (yd) / y - 1) * sign(y - y{-l)} 

END 



3 , Model 1 -Top -Date! : 

net { 

cluster INPUT ( EQUIVALENT, IN ) ; 
cluster AGENTS ( EQUIVALENT, OUT ) ; 

connect INPUT_AGENTS ( INPUT -> AGENTS, RANDOM (20 )) ; 
connect BIAS_AGENTS ( bias -> AGENTS ) ; 

INPUT inputPl ; 

INPUT input ; 
AGENTS agentsPl; 
AGENTS agents; 

cluster ( DIM(l), HID) excessDemand; 

cluster { OUT) price; 

connect ( inputPl -> agentsPl, INPUT_AGENTS ); 

connect ( bias -> agentsPl, BIAS_AGENTS ) ; 

connect ( input -> agents , INPUT_AGENTS ) ; 

connect ( bias -> agents , BIAS_AGENTS ); 

connect ( agentsPl -> agents , DIAGONAL (1 . 0 )) ; 

connect ( agents -> excessDemand ) ; 

connect ( excessDemand -> price ) ; 

} tnlp; 



Mogliche Realisierung der Alternative 
Ausf lihrungsbeispiels : 



1 . Parameter-Datei : 

BpNet { 
Global s { 
WtPenalty { 
sel No Penalty 
Weigend { 

Lambda { 0.000000 } 
AutoAdapt { T } 
wO { 1.000000 } 
DeltaLambda { 0.000001 } 
ReducFac { 0.900000 } 
Gamma { 0.900000 ) 
DesiredError { 0.000000 } 

} 

Wt Decay { 

Lambda { 0.010000 } 
AutoAdapt { F } 
AdaptTime { 10 } 
EpsObj { 0.001000 } 
Ob j Set { Training } 
EpsilonFac { 1.000000 } 

} 

ExtWtDecay { 

Lambda { 0.001000 } 
AutoAdapt { F } 
AdaptTime { 10 } 



199902091 



EpsObj { 0.001000 } 
Ob j Set { Training } 
EpsilonFac { 1.000000 } 

} 

Finnoff { 

AutoAdapt { T } 
Lambda { 0.000000 } 
DeltaLambda { 0.000001 } 
ReducFac { 0.900000 } 
Gamma { 0.900000 } 
DesiredError { 0.000000 } 

} 

} 

ErrorFunc { 
sel LnCosh 
|x| { 

parameter { 0.050000 ) 

) 

LnCosh { 

parameter { 2.000000 } 

} 

} 

AnySave { 

file_name { f.Globals.dat } 

} 

AnyLoad { 

file_name { f.Globals.dat } 

) 

ASCII { T } 

} 

LearnCtrl { 
sel Stochastic 
Stochastic { 

PatternSelection { 
sel Permute 
SubSample { 

Percent { 0.500000 } 

) 

ExpRandom { 

Lambda { 2.000000 } 

} 

) 

WtPruneCtrl { 
PruneSchedule { 
sel FixSchedule 
FixSchedule { 
Limit_0 { 10 } 
Limit_l { 10 } 
Limit_2 { 10 } 
Limit_3 { 10 } 
RepeatLast { T } 

} 

DynSchedule { 
MaxLength { 4 } 
MinimuraRuns { 0 } 
Training { F } 
Validation { T } 
Generalization { F } 

} 

DivSchedule { 

Divergence { 0.100000 } 
MinEpochs { 5 } 

} 

} 

PruneAlg { 
sel FixPrune 
FixPrune { 

Perc_0 { 0.100000 } 
PerG_l { 0.100000 } 
Perc_2 { 0.100000 } 
Perc_3 { 0.100000 } 

} 

Epsi Prune { 

DeltaEps { 0.050000 } 
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StartEps { 0.050000 } 
MaxEps { 1.000000 } 
ReuseEps { F } 

} 

} 

Tracer { 

Active { F } 

Set { Validation } 

File { trace } 

} 

Active { F } 
Randomize { 0.000000 } 
PruningSet { Train. +Valid. } 
Method { S- Pruning } 

} 

StopControl { 
EpochLimit { 
Active { F } 
MaxEpoch { 60 } 

} 

MovingExpAverage { 
Active { F } 
MaxLength { 4 } 
Training { P } 
Validation { T } 
Generalization { F } 
Decay { 0.900000 } 

} 

CheckObjectiveFct { 
Active { F } 
MaxLength { 4 } 
Training { F } 
Validation { T } 
Generalization { F } 

} 

CheckDelta { 
Active { F } 
Divergence { 0.100000 } 

} 

} 

EtaCtrl { 
Mode { 
sel EtaSchedule 
EtaSchedule { 

SwitchTime { 10 } 
ReductFactor { 0.950000 } 

} 

FuzzCtrl { 

MaxDeltaObj { 0.300000 } 
MaxDelta20bj { 0.300000 } 
MaxEtaChange { 0.020000 } 
MinEta { 0.001000 } 
MaxEta { 0.100000 } 
Smoother { 1.000000 } 

} 

} 

Active { F } 

} 

LearnAlgo { 
sel VarioEta 
VarioEta { 

MinCalls { 50 } 

} 

MomentumBackProp { 
Alpha { 0.050000 } 

} 

Quickprop { 

Decay { 0.050000 } 
Mu { 2.000000 } 

} 

} 

Any Save { 

file_name { f.Stochastic.dat } 

} 
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AnyLoad { 

file_name { f.Stochastic.dat } 

} 

BatchSize { 10 } . 
Eta { 0.010000 } 
DerivEps { 0.000000 } 

) 

TrueBatch { 

PatternSelection { 
sel Sequential 
SubSample { 

Percent { 0.500000 } 

} 

ExpRandom { 

Lambda { 2.000000 } 

} 

} 

WtPruneCtrl { 
Tracer { 

Active { F } 

Set { Validation } 

File { trace } 

} 

Active { F } 
Randomize { 0.000000 } 
PruningSet { Train. +Valid. } 
Method { S- Pruning } 

} 

EtaCtrl { 

Active { F } 

} 

LearnAlgo { 
sel VarioEta 
VarioEta { 

MinCalls { 200 } 

} 

MomentumBackProp { 
Alpha { 0.050000 } 

} 

Quickprop { 

Decay { 0.050000 } 
Mu { 2.000000 } 

} 

} 

AnySave { 

file__name { f.TrueBatch.dat } 

} 

AnyLoad { 

file_name { f.TrueBatch.dat } 

} 

Eta { 0.050000 } 
DerivEps { 0.000000 } 

) 

LineSearch { 

PatternSelection { 
sel Sequential 
SubSample { 

Percent { 0.500000 } 

} 

ExpRandom { 

Lambda { 2.000000 } 

} 

} 

WtPruneCtrl { 
Tracer { 

Active { F } 

Set { Validation } 

File { trace } 

} 

Active ( F } 
Randomize { 0.000000 } 
PruningSet { Train . +Valid. } 
Method { S- Pruning } 

} 
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LeamAlgo { 

sel Con j Gradient 
VarioEta { 

MinCalls { 200 } 

} 

MomentumBackProp { 
Alpha { 0.050000 } 

} 

Quickprop { 

Decay { 0.050000 } 
Mu { 2.000000 } 

} 

Low-Memory-BFGS { 
Limit { 2 } 

} 

} 

AnySave { 

file_name { f.LineSearch.dat } 

} 

AnyLoad { 

file_name { f.LineSearch.dat } 

} 

EtaNull { 1.000000 } 
MaxSteps { 10 } 
LS_Precision { 0.500000 } 
TrustRegion { T } 
DerivEps { 0.000000 } 
BatchSize { 2147483647 } 

} 

GeneticWeightSelect { 
PatternSelection { 
sel Sequential 
SiibSample { 

Percent { 0.500000 } 

} 

ExpRandom { 

Lambda { 2.000000 } 

} 

} 

LearnAlgo { 
sel VarioEta 
VarioEta { 

MinCalls { 200 } 
} . 

MomentumBackProp { 
Alpha { 0.050000 } 

) 

} 

ObjFctTracer { 
Active { F } 
File { objFunc } 

} 

SearchControl { 
SearchStrategy { 
sel HlllClimberControl 
HillClimberControl { 

%InitialAlive { 0.950000 } 
Inherit Weights { T } 
Beta { 0.100000 } 

MutationType { DistributedMacroMutation } 
MaxTrials { 50 } 

} 

PBILControl { 

%InitialAlive { 0.950000 } 
InheritWeights { T } 
Beta { 0.100000 } 
Alpha { 0.100000 } 
PopulationSize { 40 } 

} 

PopulationControl { 

pCrossover { 1.000000 } 
CrossoverType { SimpleCrossover } 
Scaling { T } 

ScalingFactor { 2.000000 } 
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Sharing { T } 

SharingFactor { 0.050000 } 
Populations! ze { 50 } 
min.% Initial Alive { 0.010000 } 
Tnax.%InitialAlive { 0.100000 } 



pMutation 



0.000000 



10 



15 



20 



25 



30 



35 



40 



45 



50 



55 



60 



65 



70 



} 

ObjectiveFunctionWeights { 
%Alive { 0.600000 } 
E{TS) { 0.200000 } 
Improvement (TS) { 0,000000 } 
E(VS) { 1.000000 } 
Improvement (VS) ( 0.000000 } 
(E(TS) -E(VS) )/max(E(TS) ,E(VS) ) { 0.000000 } 
LipComplexity { 0.000000 } 
OptComplexity { 2.000000 } 
testVal (dead) -testVaK alive) { 0.000000 } 

} 

AnySave { 

file_name { f.GeneticWeightSelect.dat } 

} 

AnyLoad { 

file_name { f.GeneticWeightSelect.dat } 

} 

Eta { 0.050000 } 
DerivEps { 0.000000 } 
BatchSize { 5 } 
#minEpochs ForFi t nes sTes t 
#maxEpochsForFitnessTest { 
SelectWeights { T } 
SelectNodes { T } 
maxGrowthOfValError { 0.005000 } 



{ 2 } 
} 



} 
} 

CCMenu { 
Clusters { 

mlp. price Input { 
Act Function { 
sel id 
plogistic { 

parameter { 0.500000 } 

} 

ptanh { 

parameter { 0.500000 } 

} 

pid { 

parameter { 0.500000 } 



} 
} 

InputModif ication { 
sel None 
Adapt iveUniformNoise { 
NoiseEta { 1.000000 } 
DampingFactor { 1.0000 00 } 

} 

Adapt iveOaussNoise { 
NoiseEta { 1.000000 } 
DampingFactor { 1.000000 } 

FixedUniformNoise { 
SetNoiseLevel { 

NewNoiseLevel { 1.045229 } 

} 

} 

FixedGaussNoise { 
SetNoiseLevel { 

NewNoiseLevel { 1.045229 } 

} 



} 



SaveNoiseLevel { 

Filename { noise_level.dat } 
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LoadNo i s eLeve 1 { 

Filename { noise_level.dat } 

} 

SaveManipulatorData { 

Filename { inputManip.dat } 

} 

LoadManipulatorData { 

Filename { inputManip.dat } 

} 

} 

mlp . input { 
Act Function { 
sel id 
plogistic { 

parameter { 0.500000 } 

} 

ptanh { 

parameter { 0.500000 } 

} 

pid { 

parameter { 0.500000 } 

} 

} 

InputModif ication { 
sel None 
AdaptiveUniformNoise { 
NoiseEta { 1.000000 } 
DampingFactor { 1.000000 } 

} 

Adapt iveGaussNoise { 
NoiseEta { 1.000000 } 
DampingFactor { 1.000000 } 

} 

FixedUniformNoise { 
SetNoiseLevel { 

NewNoiseLevel { 1.045229 

} 

} 

FixedGaussNoise { 
SetNoiseLevel { 

NewNoiseLevel { 1.045229 

} 

} 

) 

SaveNois eLeve 1 { 

Filename { noise_level.dat } 

} 

LoadNois eLeve 1 { 

Filename { noise_level.dat } 

} 

SaveManipulatorData { 

Filename { inputManip.dat } 

} 

LoadManipulatorData { 

Filename { inputManip.dat } 

} 

Norm { NoNorm } 

} 

mlp.excessDemand { 
ActFunction { 
sel id 
plogistic { 

parameter { 0.500000 } 

} 

ptanh { 

parameter { 0.500000 } 

} 

pid { 

parameter { 0.500000 } 

} 

} 

ErrorFunc { 
sel |x| 



199902091 




58 

|x| { 

parameter { 0.050000 } 

} 

LnCosh { 

parameter { 2.000000 } 

} 

} 

ToleranceFlag { F } 
Tolerance { 0.000000 } 
Weighting { 30,000000 } 

} 

mlp . agent s { 
Act Function { 
sel tanh 
plogistic { 

parameter { 0.500000 } 

} 

ptanh { 

parameter { 0.500000 } 

} 

pid { 

parameter { 0.500000 } 

} 

) 

Error Func { 
sel Prof Max 

|xi { 

parameter { 0.050000 } 

} 

LnCosh { 

parameter { 2.000000 } 

} 

} 



Norm { NoNorm } 





ToleranceFlag { F } 
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1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 

1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 
1.000000 1.000000 } 

} 

mlp.priceOutput { 
ActFunction { 
sel id 
plogistic { 

parameter { 0.500000 } 

} 

ptanh { 

parameter { 0.500000 } 

} 

pid { 

parameter { 0.500000 } 

} 

} 

ErrorFunc { 
sel none 
|x| { 

parameter { 0.050000 } 

) 

LnCosh { 

parameter { 2.000000 } 

} 

} 

ToleranceFlag { F } 
Tolerance { 0.000000 } 
Weighting { 1.000000 } 

} 

} 

Connectors { 

mlp. agents- >excessDemand { 
WeightWatcher { 
Active { T } 
MaxWeight { 1.0000 00 } 
MinWeight { 1,0 00000 } 

} 

LoadWeightsLocal { 
Filename { std } 

SaveWeightsLocal { 
Filename { std ) 

} 

Alive { T } 
WtFreeze { T } 

AllowGeneticOptimization { F } 
Penalty { NoPenalty } 
AllowPruning { F } 
EtaModifier { 1.000000 } 

} 

mlp .priceOutput->agents { 
WeightWatcher { 
Active { T } 
MaxWeight { -0.0010 00 } 
MinWeight { -2.000000 } 

} 

LoadWeightsLocal { 
Filename { std } 

SaveWeightsLocal { 
Filename { std } 

} 

Alive { T } 
WtFreeze { F } 

AllowGeneticOptimization { F } 
Penalty { NoPenalty } 
AllowPruning { F } 
EtaModifier { 1.000000 } 

} 

mlp . input- >agents { 
WeightWatcher { 
Active { F } 
MaxWeight { 1.000000 } 
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MinWeight { 0.000000 } 

} 

LoadWeightsLocal { 
Filename { std } 

5 } 

SaveWeightsLocal { 
Filename { std } 

} 

Alive { T } 
10 WtFreeze { F } 

AllowGeneticOptimization { F } 
Penalty { NoPenalty } 
AllowPruning { T } 
EtaModifier { 1.000000 } 

15 } 

mlp.bias->agents { 
Weight Wat Cher { 
Active { F } 
MaxWeight { 1.000000 } 
20 MinWeight { 0.000000 } 

} 

LoadWeightsLocal { 
Filename { std } 

2 5 SaveWeightsLocal { 

Filename { std } 

} 

Alive { T } 

WtFreeze { F } 

3 0 AllowGeneticOptimization { F } 

Penalty { NoPenalty } 
AllowPruning { F } 
EtaModifier { 1.000000 } 

35 mlp.priceInput->priceOutput { 

Weight Watcher { 
Active { F } 
MaxWeight { 1.000000 } 
MinWeight { 0.000000 } 

40 } 

LoadWeightsLocal { 
Filename { std } 

SaveWeightsLocal { 
45 Filename { std } 

Alive { T } 
WtFreeze { T } 

AllowGeneticOptimization { F } 
50 Penalty { NoPenalty } 

AllowPruning { F } 
EtaModifier { 1.000000 } 

} 

mlp . excessDemand- >priceOutput ( 
55 WeightWatcher { 

Active { T } 
MaxWeight { -0.010000 } 
MinWeight { -0.010000 } 

} 

60 LoadWeightsLocal { 

Filename { std ) 

SaveWeightsLocal { 
Filename { std } 

65 } 

Alive { F } 

WtFreeze { T } 

AllowGeneticOptimization { F } 
Penalty { NoPenalty } 
70 AllowPruning { F } 

EtaModifier { 1.000000 } 

mlp.priceOutput->priceOutput { 
WeightWatcher { 



199902091 




61 

Active { F } 
MaxWeight { 1.000000 } 
MinWeight { 0.000000 } 

} 

LoadWeightsLocal { 
Filename { std } 

} 

SaveWeightsLocal { 
Filename { std } 

} 

Alive { F } 
WtFreeze { T } 

AllowGeneticOptimization { F } 
Penalty { NoPenalty } 
AllowPruning { F } 
EtaModifier { 1.000000 } 

} 

) 

AnySave { 

file_name { f.CCMenu.dat } 

} 

AnyLoad { 

file_name { f.CCMenu.dat } 

} 

} 

RecPar { 

decay_c { 1-000000 } 
delta_t { 1.000000 } 
epsilon { 0.001000 } 
max_iter { 30 } 
show { T } 
Reset_Errors { T } 

} 

TestRun { 

Filename { Test } 
Part .Transformed { F } 

} 

Online { 

Filename { Online.dat } 

} 

} 



2 . Spezif ikations-Datei : 

APPLICATION Prognose 



MODE DAY week: 5 

FROM 01.01.1991 TO MAX 

TRAINING FROM 01.01.1991 TO 03.09.1996 
VALIDATION FROM 03.09.1995 TO 03.09.1996 



INPUT 

BEGIN DEMUSD "DMARKER/USDOLLR" 
X = FILE data/dol.txt COLUMN 1 

INPUT = scale({x - x(>l)) / x(-l)) 

INPUT = sGale({x - 2 * x{-l) + x{-2)) / x) 

END 



BEGIN JPYUSD " JAPAYEN/USDOLLR" 
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X = FILE data/dol.txt COLUMN 2 

INPUT - scale((x - x(-l)) / x(-l)) 

INPUT = scale((x - 2 * x(-l) + x(-2)) / x) 



BEGIN ECUS3M "EURO-CURRENCY (LDN) US$ 3 MONTHS - MIDDLE RATE" 

X = FILE data/dol.txt COLUMN 3 

INPUT = scale((x - x(-l)) / x(-l)) 

INPUT = scale((x - 2 * x{-l) + x{-2)) / x) 



BEGIN ECWGM3M "EURO-CURRENCY (LDN) D-MARK 3 MONTHS - MIDDLE. RATE' 
X = FILE data/dol.txt COLUMN 4 

INPUT = scale ({x - x(-l)) / x(-l)) 

INPUT = scale({x - 2 * x(-l) + x(-2)) / x) 

END 



BEGIN AUSGVG4RY "US TOTAL 7-10 YEARS DS GOVT. INDEX - RED. YIELD' 
X = PILE data/dol.txt COLUMN 5 

INPUT = scale ((x - x(-l)) / x(-l)) 

INPUT = scale ((x - 2 * x(-l) + x(-2)} / x) 

END 



BEGIN ABDGVG4RY "BD TOTAL 7-10 YEARS DS GOVT. INDEX - RED. YIELD' 
X = FILE data/dol.txt COLUMN 6 

INPUT - scale((x - x(-l)) / x(-l)) 

INPUT = scale({x - 2 * x(-l) + x(-2)) / x) 

END 



BEGIN AJPGVG4RY "JP TOTAL 7-10 YEARS DS GOVT. INDEX - RED. YIELD 
x - FILE data/dol.txt COLUMN 7 

INPUT = scale ((X - x{-l)) / x(-l)) 

INPUT = scale((x - 2 * x(-l) + x(-2)) / x) 

END 



BEGIN TOTMKUSRI "US-DS MARKET - TOT RETURN IND" 
X = FILE data/dol.txt COLUMN 8 

INPUT = scale({x - x(-l)) / x(-l)) 

INPUT = scalet(x - 2 * x(-l) + x(-2)) / x) 

END 



BEGIN TOTMKBDRI "GERMANY-DS MARKET - TOT RETURN IND" 
X - FILE data/dol.txt COLUMN 9 

INPUT = scale ((x - x{-l)) / x(-l)) 

INPUT = scale ((x - 2 * x(-l) + x(-2)) / x) 

END 



BEGIN NYFECRB "COMMODITY RESEARCH BUREAU INDEX-CRB - PRICE INDEX 
X = FILE data/dol.txt COLUMN 10 
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INPUT = scale((x - x(-l)) / x(-l}) 

INPUT * scale({x - 2 * x(-l) + x(-2)) / x) 

END 

5 

BEGIN GOLDBLN "GOLD BULLION $/TROY OUNCE" 
X = FILE data/dol.txt COLUMN 11 

10 INPUT = scale ((x - x{-l)) / x(-l)) 

INPUT = scale((x - 2 * x(-l) + x(-2)) / x) 

END 

15 

TARGET CLUSTER mlp .excessDemand 
BEGIN excessDemand 

20 

TARGET = 0 

END 



25 



TARGET CLUSTER mlp. agents 



Hi 



30 



35 



40 



45 
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55 
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BEGIN agents behavior 

X = FILE data/dol.txt COLUMN 1 



TARGET 


- 


100 




ln(x(l) 


/ x) 


TARGET 




100 




In (x ( 1 ) 


/ X} 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x{l) 


/ x) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 




ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x{l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


■k 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ x) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln{x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X} 


TARGET 




100 


* 


ln{x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ x) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x{l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln{x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X} 


TARGET 




100 


* 


ln(x{l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 


TARGET 




100 


* 


ln(x(l) 


/ X) 



199902091 




TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

5 TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x{l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET - 100 * ln(x(l) / x) 

10 TARGET = 100 * ln(x(l) / x) 



TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

15 TARGET = 100 * ln(x(l) / x) 

TARGET =s 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET « 100 * ln(x(l) / x) 

TARGET = 100 * ln{x(l) / x) 

20 TARGET = 100 * ln{x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

25 TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 10 0 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

30 TARGET = 100 * ln(x{l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

35 TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x{l) / x) 

TARGET = 100 * ln(x(l) / x) 

40 TARGET = 100 * ln{x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

45 

TARGET = 100 * ln(x(l) / x) 

T7\RGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x{l) / x) 

50 TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x{l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

55 TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

60 TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

65 TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 



70 



TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln{x(l) / x) 

TARGET = 100 * ln(x(l) / x) 

TARGET = 100 * ln(x(l) / x) 
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END 



40 



45 



TARGET CLUSTER mlp .priceOutput 

BEGIN price 

X FILE data/dol.txt COLUMN 1 

TARGET = 100 * ln(x(l) / x) 
ASSIGN TO channel 

END 



SIGNAL 



50 



BEGIN hit rate - NORMSUM (signal) 
t = TARGET channel 
o = OUTPUT channel 



55 



SIGNAL = IF t * O > 0 THEN 1 ELSE 0 



END 



60 



BEGIN Rol 

y = FILE data/dol.txt COLUMN 1 
o = OUTPUT channel 



END 



SIGNAL = (yd) / y - 1) * sign(o) 



65 



70 



BEGIN realized potential = Relsum(signall, signal2) 
y = FILE data/dol.txt COLUMN 1 
o = OUTPUT channel 

SIGNAL = (yd) / y - 1) * sign(o) 

SIGNAL = abs(y(l) / y - 1) 

END 
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BEGIN Backtrans format ion of forecasts 
y = FILE data/dol.txt COLUMN 1 
o = OUTPUT channel 

SIGNAL = yd) 

SIGNAL = y * (1 + o / 100) 

END 



BEGIN Buy Sc Hold 

y = FILE data/dol.txt COLUMN 1 

SIGNAL = y{l) / y - 1 

END 



BEGIN Naiv Prognose 

y = FILE data/dol.txt COLUMN 1 

SIGNAL = (yd) / y - 1) * sign(y - y(-l)) 

END 



3 ■ Modell-Top-Datei : 



net { 

cluster ( IN 
cluster ( IN 
cluster { OUT 
cluster ( OUT 
cluster { OUT 



} pricelnput; 

) input ; 
) excessDemand 
) agents; 
) priceOutput; 



connect 
connect 
connect 
connect 
connect 
connect 
connect 
} mlp; 



{ pricelnput 

( priceOutput 

{ input 
( bias 

{ agents 
( excessDemand 
( priceOutput 



-> priceOutput, ITOl ) 
■> agents ) 
-> agents, RANDOM(32)) 
-> agents ) ; 

-> excessDemand ) ; 

-> priceOutput ) ; 

-> priceOutput, ITOl ) ; 
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In diesem Dokument sind folgende Verof f entlichungen zitiert: 

[1] S. Haykin, Neural Networks: A Comprehensive Foundation, 
Mc Millan College Publishing Company, 
ISBN 0-02-352761-7, S. 498-533, 1994. 



[2] A. Zell, Simulation Neuronaler Netze, Addison-Wesley 
Publishing Company, S. 560-561, 1. Auflage, Bonn, 1994 
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Patent claims 



1. An arrangement for the computer- supported 
compensation of an inequilibrium state of a first technical 
system, 

- having a first neural network, which describes the first 
technical system; 

- having a second neural network, which describes a second 
technical system; 

- in which the first and the second neural network are 
connected to one another in such a way that an inequilibrium 
state of the first technical system can be compensated by the 
second neural network, 

2. The arrangement as claimed in claim 1, in which the 
first neural network has at least a first input computing 
element and a second output computing element. 

3. The arrangement as claimed in claim 1 or 2, in 
which the second neural network has at least a second input 
computing element and a second output computing element. 

4 . The arrangement as claimed in one of claims 1 to 3 , 
in which at least some of the computing elements are 
artificial neurons. 

5. The arrangement as claimed in one of claims 1 to 4, 
in which at least some of the connections between computing 
elements are of variable configuration. 

6. The arrangement as claimed in one of claims 1 to 5, 
in which at least some of the connections have identical 
weighting values. 
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7. The arrangement as claimed in one of claims 1 to 6 , 
in which the first technical system and the second technical 
system are each subsystems of a common overall system. 

8. The arrangement as claimed in one of claims 1 to 6, 
in which the first technical system and the second technical 
system are identical. 

9. The arrangement as claimed in claim 7 or 8, used 
for determining a dynamic of a system. 

10. The arrangement as claimed in one of claims 7 to 9, 
used for predicting a future state of a system. 

11. The arrangement as claimed in claim 10, used for 
monitoring and/or controlling a system. 

12. The arrangement as claimed in claim 11, in which 
the system is a chemical reactor. 

13. A method for the computer -supported compensation of 
an inequilibrium state of a first technical system, 

- in which a first neural network, which describes the first 
technical system, is supplied with a first input variable; 

- in which a first output variable, which describes an 
inequilibrium state of the first technical system, is 
determined for the first input variable using the first 
neural network; 

- in which the first output variable is supplied, as a second 
input variable, to a second neural network which describes a 
second technical system; 

- in which a second output variable, which describes a state 
of the second technical system, is determined for the second 
input variable using the second neural network, in such a way 
that the inequilibrium state of the first technical system is 
compensated by the second neural network. 
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14. The method as claimed in claim 13, in which the 

first technical system and the second technical system each 
describe a subsystem of a common overall system. 

5 15. The method as claimed in claim 14, in which a 

dynamic of the overall system is determined using the state 
of the second technical system. 

16. The method as claimed in one of claims 13 to 15, 
10 used for predicting a future state of a system. 

17. The method as claimed in claim 16, used for 
monitoring and/or controlling a system. 

15 18. A computer program event which comprises a 

computer- readable storage medium on which a program is stored 
which, after it has been loaded into a memory of a computer, 
makes it possible for the computer to execute the following 
steps for the computer- supported compensation of an 

20 inequilibrium state of a first technical system: 

- a first neural network, which describes the first technical 
system, is supplied with a first input variable; 

- a first output variable, which describes an inequilibrium 
state of the first technical system, is determined for the 

25 first input variable using the first neural network; 

- the first output variable is supplied, as a second input 
variable, to a second neural network, which describes a 
second technical system; 

- a second output variable, which describes a state of the 
30 second technical system, is determined for the second input 

variable using the second neural network, in such a way that 
the inequilibrium state of the first technical system is 
compensated by the second neural network. 

35 19. A computer-readable storage medium on which a 

program is stored which, after it has been loaded into a 
memory of the computer, permits the computer to execute the 
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following steps for the computer- supported compensation of an 
inequilibrium state of a first technical system: 

- a first neural network, which describes the first technical 
system, is supplied with a first input variable; 

5 - a first output variable, which describes an inequilibrium 
state of the first technical system, is determined for the 
first input variable using the first neural network; 

- the first output variable is supplied, as a second input 
variable, to a second neural network, which describes a 

10 second technical system; 

- a second output variable, which describes a state of the 
second technical system, is determined for the second input 
variable using the second neural network in such a way that 
the inequilibrium state of the first technical system is 

15 compensated by the second neural network. 
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Abstract 

Arrangement and method and computer program event and 
computer-readable storage medium for the computer- supported 
5 compensation of an inequilibrium state 

In the arrangement and the method for the computer- supported 
compensation of an inequilibrium state of a first technical 
system, a first neural network describes the first technical 
10 system and a second neural network describes a second 
technical system. The first and the second neural network are 
connected to one another in such a way that an inequilibrium 
state of the first technical system is compensated by the 
second neural network. 
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Declaration and Power of Attorney For Patent Application 
Erklarung Fur Patentanmeldungen Mit Vollmacht 

German Language Declaration 



Als nachstehend benannter Erfinder erkl^re ich hiermit 
an Eides Statt: 



dass mein Wohnsitz, meine Postanschrift, und meine 
Staatsangehorigkeit den im Nachstehenden nach 
meinem Namen aufgefQhrten Angaben entsprechen, 



As a below named inventor, I hereby declare that: 



My residence, post office address and citizenship are 
as stated below next to my name, 



dass ich, nach bestem Wissen der ursprungliche, erste 
und alieinlge Erfinder (falls nachstehend nur ein Name 
angegeben ist) oder ein ursprunglicher, erster und 
Miterfinder (falls nachstehend mehrere Namen 
aufgefuhrt sind) des Gegenstandes bin, fur den dieser 
Antrag gestellt wird und fQr den ein Patent beantragt 
wird fOr die Erfindung mit dem Titel: 

Anordnunq und Verfahren sowie 



Computerprogramm-Erzeugnis und 

computerlesbares Speichermedium zur 



rechnergestutzten Kompensation eines 
Ungleichgewichtszustands eines 



technischen Systems 



deren Beschrelbung 

(zutreffendes ankreuzen) 
□ hier beigefQgt ist. 
M am 30.05.2000 ais 
PCT Internationale Anmeldung 
PCT Anmeldungsnummer 



PCT/DEQO/01764 



eingerelcht wurde und am 

abgeandert wurde (fails tatsachlich abgeandert). 



Ich bestatige hiermit, dass Ich den Inhalt der obigen 
Patentanmeldung einschliesslich der AnsprCiche 
durchgesehen und verstanden habe, die eventuell 
durch einen Zusatzantrag wie oben erwShnt abgean- 
dert wurde. 



Ich erkenne meine Pflicht zur Offenbarung irgendwel- 
cher Informationen, die fur die Prufung der voriiegen- 
den Anmeldung in Einklang mit Absatz 37, Bundes- 
gesetzbuch, Paragraph 1.56(a) von Wichtigkeit sInd, 
an. 



Ich beanspruche hiermit auslandische Prioritatsvorteile 
gemass Abschnitt 35 der Zivilprozessordnung der 
Verelnigten Staaten, Paragraph 119 aller unten ange- 
gebenen Auslandsanmeldungen fur ein Patent oder 
eine Erfindersurkunde, und habe auch alle Auslands- 
anmeldungen for ein Patent oder eine Erfindersurkun- 
de nachstehend gekennzeichnet, die ein Anmelde- 
datum haben, das vor dem Anmeldedatum der 
Anmeldung liegt, fQr die Prioritat beansprucht wird. 



I believe I am the original, first and sole inventor (if only 
one name is listed below) or an original, first and joint 
inventor (if plural names are listed below) of the 
subject matter which is claimed and for which a patent 
is sought on the invention entitled 



Assembly, 



method, 



computer 



programme and storage medium which 
can be computer-read for the computer- 
aided compensation of a state of 



ineguilibrium 



the specification of which 



(check one) 
□ is attached hereto. 
13 was filed on , 



30.05.2000 as 



PCT international application 

PCT Application No. 

and was amended on 



PCT/DEOO/01764 



(if applicable) 



I hereby state that I have reviewed and understand the 
contents of the above Identified specification, including 
the claims as amended by any amendment referred to 
above. 



I acknowledge the duty to disclose information which is 
material to the examination of this application in 
accordance with Title 37, Code of Federal Regulations, 
§1. 56(a). 



1 hereby claim foreign priority benefits under Title 35, 
United States Code, §119 of any foreign application(s) 
for patent or Inventor's certificate listed below and have 
also identified below any foreign application for patent 
or inventor's certificate having a filing date before that 
of the application on which priority is claimed: 
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German Language Declaration 


rrior Toreiyn apppiicaxions 
Prioritat beansprucht 




Prioritv Claimed 


19928776.7 DE 
(Number) (Country) 


23.06.1999 H □ 
(Day Month Year Filed) Yes No 
(Tag IVIonat Jahr eingereicht) Ja Nein 


(Number) " (Country) 
(Nummer) (Land) 


□ □ 

(Day Month Year Filed) Yes No 
\ I ag jvionai janr eingereicnij Ja Nein 


(Number) (Country) 
(Nummer) (Land) 


□ □ 

(Day Month Year Filed) Yes No 
(Tag Monat Jahr eingereicht) Ja Nein 


Ich beanspruche hiermit gemass Absatz 35 der Zivil- 
prozessordnung der Vereinigten Staaten, Paragraph 
120, den Vorzug aller unten aufgefuhrten Anmel- 
dungen und falls der Gegenstand aus jedem Anspruch 
dieser Anmeldung nicht In einer fruheren 
amerikanischen Patentanmeldung laut dem ersten 
Paragraphen des Absatzes 35 der ZivilprozeRordnung 
der Vereinigten Staaten, Paragraph 122 offenbart ist, 
erkenne ich gemass Absatz 37, Bundesgesetzbuch, 
Paragraph 1.56(a) meine Pflicht zur Offenbarung von 
Informationen an, die zwischen dem Anmeldedatum 
der fruheren Anmeldung und dem nationalen oder PCT 
internationalen Anmeldedatum dieser Anmeldung 
bekannt geworden sind. 


1 hereby claim the benefit under Title 35. United States 
Code. §120 of any United States app[ication(s) listed 
below and, insofar as the subject matter of each of the 
claims of this application is not disclosed in the prior 
United States application in the manner provided by 
the first paragraph of Title 35, United States Code, 
§122, 1 acknowledge the duty to disclose material 
information as defined in Title 37, Code of Federal 
Regulations, §156(a) which occured between the filing 
date of the prior application and the national or PCT 
International filing date of this application. 


PCTfDEOO/01764 


30.05.2000 


anhanqiq pendina 

(Status) (Status) 
(patentiert, anhangig. (patented, pending, 
aufgegeben) abandoned) 


(Application Serial No.) 
(Anmeldeseriennummer) 


(Filing Dale D, M, Y) 
(Anmeldedatum T, M, J) 


(Apptication Serial No.) 
(Anmeldeseriennummer) 


(Filing Date D.M.Y) 
(Anmeldedatum T, M; J) 


(Status) (Status) 
(patentiert, anhSngig, (patented, pending, 
aufgeben) abandoned) 


Ich erklare hiermit, dass alle von mir In der vorilegen- 
den Erklarung gemachten Angaben nach meinem 
besten Wissen und Gewlssen der vollen Wahrheit 
entsprechen. und dass ich diese eldesstattliche Erkla- 
rung in Kenntnis dessen abgebe, dass wissentlich und 
vorsatzlich falsche Angaben gemSss Paragraph 1001, 
Absatz 18 der Zivllprozessordnung der Vereinigten 
Staaten von Amerika mit Geldstrafe belegt und/oder 
Gefangnis bestraft werden koennen, und dass derartig 
wissentlich und vorsatzlich falsche Angaben die GQI- 
tlgkeit der vorliegenden Patentanmeldung oder eines 
darauf erteilten Patentes gefahrden konnen. 


1 hereby declare that all statements made herein of my 
own knowledge are true and that all statements made 
on information and belief are believed to be true, and 
fuiiher that these statements were made with the 
knowledge that willful false statements and the like so 
made are punishable by fine or imprisonment, or both, 
under Section 1001 of Title 18 of the United States 
Code and that such willful false statements may 
jeopardize the validity of the application or any patent 
issued thereon. 
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VERTRETUNGSVOLLMACHT: AIs benannter Erfinder 
beauftrage ich hlermit den nachstehend benannten 
Patentanwalt (oder die nachstehend benannten 
Patentanwalte) und/oder Patent-Agenten mit der 
Verfolgung der vorliegenden Patentannneldung sowie 
mit der Abwicklung ailer damit verbundenen Geschafte 
vor dem Patent- und Warenzeichenamt: (Name und 
Registrationsnummer anfQhren) 



POWER OF ATTORNEY: As a panned inventor, I 
hereby appoint the following attorney(s) and/or 
agent(s) to prosecute this application and transact all 
business in the Patent and Trademark Office 
connected therewith, (iist name and registration 
number) 



Customer No. 21171 



And I hereby appoint 



Telefongesprache bitte richten an: 
(Name und Telefonnummer) 



Direct Telephone Calls to: (name and telephone 
number) 



Ext. 



Postanschrlft: Send Correspondence to: 

Staas & Halsey LLP 
700 Eleventh Street NW, Suite 500 20001 Washington, DC 
Telephone: (001) 202 434 1500 and Facsimile (001) 202 434 1501 

or 

Gustomer No. 21171 



Voller Name des einzigen oder urspriinglichen Erfinders: 

Dr. RALF NEUNEIER 


Full name of ^le orffrSTi^entbr^^ ^/ 

Dr. RALB.NEUNBER 


Untersdj&ft de^rfinders ^ Datum 


Inventor's signature Date 


MUENCHEN, DEUTSCHLAND 


Residence \ i K // 

MUENCHEN J5£RMANY — / 


Staatsangehorigkert 

DE 


Citizenship 

DE 


Postanschrift 

GRAVELOTTESTR. 3 


Post Office Addess 

GRAVELOTTESTR. 3 


81667 MUENCHEN 


81667 MUENQJbLEN 


Voller Name des zweiten Miterfinders (falls zutreffend): 

Dr. HAr9S-j::^ORG ^JjyiMERMANN 


Full ^7jnie73f^cond\ipirit%^ if any: 

Dr. HANS-GEORG ZIMMERMANN 


UrifeVschryf d^ggj^lgig^ C^(S^ CMi^^ Datum 


Second Inventor's signature Date 


STaWnBERG/PERCHA, DEUTSCHLAND 


Residence ^ j ^^^/^ 

STARNBERG/PERCHA, GERMANY 


Staatsangehdrlgkeit 

DE 


CnosnsFiip — • ' 

DE 


Postanschrlft 

SCHIFFBAUERWEG 6A 


Post Office Address 

SCHIFFBAUERWEG 6A 


82319 STARNBERG/PERCHA 


82319 STARNBERG/PERCHA 



(Bitte entspreciiende Informationen und Unterscliriften im 
Falle von dritten und weiteren Miterfmdern angeben). 



(Supply similar information and signature for third and 
subsequent joint inventors). 
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